Unanswered Questions tagged with AWS Glue
Content language: English
Select up to 5 tags to filter
Sort by most recent
Browse through the questions and answers listed below or filter and sort to narrow down your results.
I have multiple Visual ETL configured correctly, but if go back to the previous screen and then try to see the job again, the display editor will lost the configuration and it will highlight some...
0
answers
0
votes
108
views
asked 4 months agolg...
Trying to figure out if it's possible to use AWS Glue crawler to parse the spark stderr logs that are dumped from emr-serverless.
The logs are space delimited. I tried running a crawler against the...
0
answers
0
votes
165
views
asked 4 months agolg...
We have a file that we used the default XML crawler to crawl the data for, and it correctly created a table and schema for the data (relevant column shown):
![Correct...
0
answers
0
votes
142
views
asked 4 months agolg...
I need to load data from my dataframe to BiqQuery table JSON type field.
There is connector that according to documentation supports this feature:...
0
answers
0
votes
56
views
asked 5 months agolg...
I'm working on a project that makes use of Glue Record Matching transforms which, by my best research though AWS docs, is only supported in Glue 2.0 jobs (and additionally, the maximum Glue version I...
0
answers
0
votes
56
views
asked 5 months agolg...
I have a data pipeline built in Redshift Serverless, with some final tables being the result. We are also running a web app that I have set up an Aurora Serverless Postgres DB, to run from. The idea...
0
answers
0
votes
124
views
asked 5 months agolg...
Hi
Trying to craw connect logs create bad metadata with fields like this inside the table:
struct<connect\:Subtype:struct<ValueString:string>>
obvious running this struct inside athena result in a...
0
answers
0
votes
430
views
asked 5 months agolg...
This error: `Service: AWSGlue; Status Code: 400; Error Code: AccessDeniedException`
I have an organisation account, I have access to the root user, but I'm trying to deploy using a PowerUser. I have...
0
answers
0
votes
140
views
asked 5 months agolg...
MSK connectors are trying to create s3 sink connectors. At this time, schema uses the schema in the Glue schema registry, and the goal is to store avro schema in s3 in parquet format.
Below is the...
0
answers
0
votes
340
views
asked 6 months agolg...
Hi all,
We found a bug in Glue triggers when editing a Scheduled typed one with custom cron set.
When we go for a trigger edition the Cron config set before is lost and the interface show us a daily...
0
answers
0
votes
50
views
asked 6 months agolg...
Scenario:
Source table: Glue Data Catalog table **study** crawled from MySQL with columns:
* id (int),
* code (varchar),
* desc (varchar)
* and 2 other columns not used in the job.
Target table:...
0
answers
0
votes
101
views
asked 6 months agolg...
We have a usecase where two appflows that should trigger one glue model,
The glue model takes more than 5 minutes to complete its run but by the time the glue job is running, we have a second job run...
0
answers
0
votes
66
views
asked 6 months agolg...