Questions tagged with AWS Glue
AWS Glue is a serverless data integration service that makes it easy to discover, prepare, and combine data for analytics, machine learning, and application development.
Content language: English
Filter questions
Select tags to filter
Sort by
Sort by most recent
Browse through the questions and answers listed below or filter and sort to narrow down your results.
2087 results
Hi AWS Support,
When I try to create an Athena table based on a Delta Lake table stored in S3, I encounter an unexpected error. I'm not sure what’s causing it, especially since I've successfully crea...
1
answers
0
votes
326
views
asked a year ago
I’m working with Hudi (hoodie) tables managed by AWS Lake Formation. Currently, AWS Glue Data Quality doesn’t support these tables, and I need to apply data quality rules on my data and surface the re...
1
answers
0
votes
267
views
asked a year ago
In Glue, I am trying to join some tables together. When joining these tables it works fine until I have to rename the keys due to overlapping field names. After this, sometimes I will get a perfect jo...
1
answers
0
votes
197
views
asked a year ago
This seems like a really basic thing but I feel frustrated that I have not been able to figure it out. When it comes to writing dynamic frames to files and to the glue data catalog there are three opt...
1
answers
0
votes
322
views
asked a year ago
Athena query by partition column returns an error on hive partitioned table (vpc flow logs) - getting a message as column not found - I provided all the permissions for glue & athena - looks like its ...
2
answers
0
votes
275
views
asked a year ago
I'm using the SAP OData Connector for AWS Glue to extract SAP data based on specific condition involving a single field (such as a fiscal period or profit center), the expected record count is relati...
1
answers
0
votes
352
views
asked a year ago
Hi, I’m running into an issue when using PyIceberg with AWS Glue Iceberg REST catalog during schema evolution.
Environment:
- PyIceberg: latest (with pyarrow)
- Catalog: AWS Glue REST (setup shared b...
3
answers
1
votes
397
views
asked a year ago
I have a data repository in JSON that includes an attribute called "timestamp" (which is a reserved word). This attribute is part of a nested JSON/struct.
The way I query the data is by creating a Gl...
3
answers
0
votes
200
views
asked a year ago
My existing automation is configured to trigger AWS Lambda function using EventBridge Rule upon successful Glue Crawler run execution. However, my Event Rule is not capturing Crawler execution. Attach...
1
answers
0
votes
169
views
asked a year ago
Hello, I'll explain my goal:
I have two databases, one for production and one for staging, both on PostgreSQL in RDS. I want to transform some tables from my production database and move them to the ...
2
answers
0
votes
348
views
asked a year ago
I am trying to test Glue DQ using glue catalog for a table in AWS Glue, But I am facing error for data quality rule as I result DQ is getting failed with error "Exception in User Class: java.lang.NoCl...
1
answers
0
votes
190
views
asked a year ago
question contrived for this post. say , i have few hundred thousand record in dynamo and i want to select/query subset of data into another dynamo . what are some of the options to do such task ?
on...
2
answers
0
votes
192
views
asked a year ago