Unanswered Questions tagged with AWS Glue
Content language: English
Select up to 5 tags to filter
Sort by most recent
Browse through the questions and answers listed below or filter and sort to narrow down your results.
Hello everyone,
we are facing a major issue regarding AWS Glue's workflows. For some reason starting from today 01/02/2024, we have noticed that some `ANY` and `ALL` triggers will activate and...
0
answers
5
votes
160
views
asked 4 months agolg...
Hi all,
I gave full access to S3 and Glue for the role.
Created a crawler to use data in S3 for Glue Catalog tables. The crawler runs successful and logs in CloudWatch also show table created and...
0
answers
0
votes
209
views
asked 4 months agolg...
Hi all! I need some guidance on the proper way to connect to an Oracle Free Tier Autonomous Database from a Glue ETL Job. I’ve been using the following code snippet, but I encountered an error -...
0
answers
0
votes
625
views
asked 5 months agolg...
I have multiple Visual ETL configured correctly, but if go back to the previous screen and then try to see the job again, the display editor will lost the configuration and it will highlight some...
0
answers
0
votes
111
views
asked 5 months agolg...
Trying to figure out if it's possible to use AWS Glue crawler to parse the spark stderr logs that are dumped from emr-serverless.
The logs are space delimited. I tried running a crawler against the...
0
answers
0
votes
168
views
asked 5 months agolg...
We have a file that we used the default XML crawler to crawl the data for, and it correctly created a table and schema for the data (relevant column shown):
![Correct...
0
answers
0
votes
145
views
asked 5 months agolg...
I need to load data from my dataframe to BiqQuery table JSON type field.
There is connector that according to documentation supports this feature:...
0
answers
0
votes
57
views
asked 5 months agolg...
I'm working on a project that makes use of Glue Record Matching transforms which, by my best research though AWS docs, is only supported in Glue 2.0 jobs (and additionally, the maximum Glue version I...
0
answers
0
votes
58
views
asked 5 months agolg...
I have a data pipeline built in Redshift Serverless, with some final tables being the result. We are also running a web app that I have set up an Aurora Serverless Postgres DB, to run from. The idea...
0
answers
0
votes
128
views
asked 5 months agolg...
Hi
Trying to craw connect logs create bad metadata with fields like this inside the table:
struct<connect\:Subtype:struct<ValueString:string>>
obvious running this struct inside athena result in a...
0
answers
0
votes
432
views
asked 5 months agolg...
This error: `Service: AWSGlue; Status Code: 400; Error Code: AccessDeniedException`
I have an organisation account, I have access to the root user, but I'm trying to deploy using a PowerUser. I have...
0
answers
0
votes
144
views
asked 5 months agolg...
MSK connectors are trying to create s3 sink connectors. At this time, schema uses the schema in the Glue schema registry, and the goal is to store avro schema in s3 in parquet format.
Below is the...
0
answers
0
votes
342
views
asked 6 months agolg...