Questions tagged with AWS Glue
Content language: English
Select up to 5 tags to filter
Sort by most recent
Browse through the questions and answers listed below or filter and sort to narrow down your results.
Actually i uploaded one JSON file into my s3 bucket which is having nested JSON data. and, created Athena table out of it by using glue crawler. after that when i was trying to query the table i am...
0
answers
0
votes
351
views
asked 2 months agolg...
I have an AWS Glue job that transfers data from a PostgreSQL database to Amazon S3. The job functioned efficiently until the size of the data increased. Now, when attempting to save approximately 2-3...
1
answers
0
votes
199
views
asked 2 months agolg...
0
I'm encountering a NoSuchKey error while attempting to create an Athena Iceberg table using AWS Wrangler. Here's the anonymized error message:
{
"errorMessage": "GENERIC_INTERNAL_ERROR:...
0
answers
0
votes
246
views
asked 2 months agolg...
Hello,
I have an AWS Glue job that is only supposed to perform an SQL query on the current status. Unfortunately, I always get the following error: "Error Category: QUERY_ERROR; AnalysisException:...
1
answers
0
votes
293
views
asked 2 months agolg...
Question:
We currently have approximately 100 tables in delta format, partitioned by yyyy, mm, dd, hh, mm. Our current process involves reading these delta tables via a crawler, cataloging them, and...
0
answers
0
votes
370
views
asked 2 months agolg...
Reading few gb say 15gb of parquet skewed data , after few transformation such as data type change for some columns and then doing repartitions (dataframe.repartition(120)) before writing it to s3 in...
1
answers
0
votes
306
views
asked 2 months agolg...
While trying to visualize the Glue Workflow detail page I get the following error:
```
There was an issue processing your request.
Error: ChunkLoadError: Loading chunk 7 failed. (error:...
1
answers
0
votes
195
views
asked 2 months agolg...
i can acceed with ubuntu and AWS Cli in WSL1 environment, to a ldap server, using ldap3 library on my WSL1 Python3 environment. but when trying to migrate the code to AWS Cloud Environment, can not...
1
answers
0
votes
197
views
asked 2 months agolg...
When we try to create a crawler in one of our accounts, for example account id XXXXXXX86, in which we have an s3 with a datalake, when we create the process and with the roles configured as specified...
Accepted AnswerAWS Glue
1
answers
0
votes
164
views
asked 2 months agolg...
I have a glue job which pushes the data from glue into open search.
The index Id column is automatically created while inserting the data into open search.
I would like to pass the index id _id...
1
answers
0
votes
369
views
asked 2 months agolg...
How can I "automatically" add new partitions to a Glue table based on a Hive formatted S3 bucket?lg...
I have a Bucket containing AWS AppStream logs on format `s3://appstream-logs.../sessions/schedule=DAILY/year=2024/month=04/day=03/daily-session-report-2024-04-03.csv`. I have made this data available...
2
answers
0
votes
157
views
asked 2 months agolg...
Iam unable to create AWS Glue service even with root access. especially crawler section. its showing my account is denied to create the service. appreciate your help!
2
answers
0
votes
133
views
asked 2 months agolg...