Questions tagged with AWS Glue
Content language: English
Select up to 5 tags to filter
Sort by most recent
Browse through the questions and answers listed below or filter and sort to narrow down your results.
0
I'm encountering a NoSuchKey error while attempting to create an Athena Iceberg table using AWS Wrangler. Here's the anonymized error message:
{
"errorMessage": "GENERIC_INTERNAL_ERROR:...
0
answers
0
votes
208
views
asked 10 days agolg...
Hello,
I have an AWS Glue job that is only supposed to perform an SQL query on the current status. Unfortunately, I always get the following error: "Error Category: QUERY_ERROR; AnalysisException:...
1
answers
0
votes
215
views
asked 10 days agolg...
Question:
We currently have approximately 100 tables in delta format, partitioned by yyyy, mm, dd, hh, mm. Our current process involves reading these delta tables via a crawler, cataloging them, and...
0
answers
0
votes
327
views
asked 11 days agolg...
Reading few gb say 15gb of parquet skewed data , after few transformation such as data type change for some columns and then doing repartitions (dataframe.repartition(120)) before writing it to s3 in...
1
answers
0
votes
244
views
asked 13 days agolg...
While trying to visualize the Glue Workflow detail page I get the following error:
```
There was an issue processing your request.
Error: ChunkLoadError: Loading chunk 7 failed. (error:...
1
answers
0
votes
155
views
asked 14 days agolg...
i can acceed with ubuntu and AWS Cli in WSL1 environment, to a ldap server, using ldap3 library on my WSL1 Python3 environment. but when trying to migrate the code to AWS Cloud Environment, can not...
1
answers
0
votes
148
views
asked 14 days agolg...
When we try to create a crawler in one of our accounts, for example account id XXXXXXX86, in which we have an s3 with a datalake, when we create the process and with the roles configured as specified...
Accepted AnswerAWS Glue
1
answers
0
votes
131
views
asked 15 days agolg...
I have a glue job which pushes the data from glue into open search.
The index Id column is automatically created while inserting the data into open search.
I would like to pass the index id _id...
1
answers
0
votes
211
views
asked 16 days agolg...
How can I "automatically" add new partitions to a Glue table based on a Hive formatted S3 bucket?lg...
I have a Bucket containing AWS AppStream logs on format `s3://appstream-logs.../sessions/schedule=DAILY/year=2024/month=04/day=03/daily-session-report-2024-04-03.csv`. I have made this data available...
2
answers
0
votes
89
views
asked 16 days agolg...
Iam unable to create AWS Glue service even with root access. especially crawler section. its showing my account is denied to create the service. appreciate your help!
2
answers
0
votes
89
views
asked 17 days agolg...
Create Crawler errorlg...
One crawler failed to create
The following crawler failed to create: "new_crawler"
Here is the most recent error message: Account ************* is denied access.
I attached all screenshots in below...
1
answers
0
votes
72
views
asked 17 days agolg...
I am working on migrating data from MySQL to S3 using AWS DMS. I want to employ wildcard mapping for the schema name in the DMS task's selection rules. Specifically, I aim to include tables from...
6
answers
0
votes
147
views
asked 18 days agolg...