Unanswered Questions tagged with AWS Glue
Content language: English
Select up to 5 tags to filter
Sort by most recent
Browse through the questions and answers listed below or filter and sort to narrow down your results.
I am trying to create a Glue job for migrating data from BigQuery to an S3 bucket. I have created a BigQuery connection in AWS Glue. The connection uses the Secret Id to reference a secret name in AWS...
0
answers
0
votes
50
views
asked 2 days agolg...
Actually i uploaded one JSON file into my s3 bucket which is having nested JSON data. and, created Athena table out of it by using glue crawler. after that when i was trying to query the table i am...
0
answers
0
votes
288
views
asked 7 days agolg...
0
I'm encountering a NoSuchKey error while attempting to create an Athena Iceberg table using AWS Wrangler. Here's the anonymized error message:
{
"errorMessage": "GENERIC_INTERNAL_ERROR:...
0
answers
0
votes
202
views
asked 9 days agolg...
Question:
We currently have approximately 100 tables in delta format, partitioned by yyyy, mm, dd, hh, mm. Our current process involves reading these delta tables via a crawler, cataloging them, and...
0
answers
0
votes
322
views
asked 9 days agolg...
AWS Glue DataBrewlg...
Hello All ,
I am trying to clean up my dataset see below ![Dataset](/media/postImages/original/IMlISUqk8QRVCZTKGDM3uwcA).
I want to remove the first row since the name is invalid and want to add it...
0
answers
0
votes
97
views
asked a month agolg...
Hi everyone,
I've been running a Glue job smoothly for the past year, processing a collection of individual data blocks from Location A and transferring them to Location B. Each block shares the same...
0
answers
0
votes
85
views
asked a month agolg...
I am working in the Glue ETL Visual Editor and I've started to encounter this error `QuotaExceededError - Failed to execute 'setItem' on 'Storage'`.
It is preventing me from even starting a Data...
0
answers
0
votes
99
views
asked a month agolg...
I received this error - ResourceSetupError: Exception when listing images from AWS Glue. There are no logs because the duration of the job was 0s.
Why? =/
0
answers
0
votes
338
views
asked a month agolg...
Cloning a notebook ETL job does not clone the notebook code. That is probably the most important thing to clone.
0
answers
0
votes
71
views
asked 2 months agolg...
I created table with Glue Crawler op top of JSON files lying on s3. I can successfully query this table with Athena. However while trying to read it with Glue PySpark I am got error:
`Error Category:...
0
answers
0
votes
65
views
asked 2 months agolg...
Hello everyone,
we are facing a major issue regarding AWS Glue's workflows. For some reason starting from today 01/02/2024, we have noticed that some `ANY` and `ALL` triggers will activate and...
0
answers
5
votes
135
views
asked 3 months agolg...
Hi all,
I gave full access to S3 and Glue for the role.
Created a crawler to use data in S3 for Glue Catalog tables. The crawler runs successful and logs in CloudWatch also show table created and...
0
answers
0
votes
187
views
asked 3 months agolg...