Questions tagged with AWS Glue
Content language: English
Select up to 5 tags to filter
Sort by most recent
Browse through the questions and answers listed below or filter and sort to narrow down your results.
Hello... I have a query regarding the conversion of Protobuf objects stored in an S3 bucket (I possess a list of .pb.gz objects within the "Origin" bucket). I aim to develop a Glue job to transform...
2
answers
0
votes
194
views
asked 5 months agolg...
Hello!
I am using Redshift Serverless and am having some difficulty with auto-complete. This understandably leads to tedious typing of queries and introduces unneeded typos.
We have several...
1
answers
0
votes
480
views
asked 5 months agolg...
This is a followup question to the post https://repost.aws/questions/QUzURnlUzOR9mfoQbiLwCNvA/incremental-data-capture-from-dynamodb-to-s3
With PITR feature in DDB, is it possible to incrementally...
1
answers
0
votes
558
views
asked 5 months agolg...
I am running a Glue ETL job to load data from parquet file from S3 into Redshift table.
![Enter image description here](/media/postImages/original/IMrrvRKNfNQ0604h-FuKYtFQ)
I am able to get data...
2
answers
0
votes
340
views
asked 5 months agolg...
I am facing an error in my glue job while accessing the huge volume of data from the source[Aurora MySQl].
```
[Error] The table '/rdsdbdata/tmp/#sql104_24f40a_0' is full
```
I want to know the root...
1
answers
0
votes
414
views
asked 5 months agolg...
I have uploaded two separate csv files (just to check the query results) with the tables in the right order and values in S3, but everytime I run the crawler and view the individual table data in...
1
answers
0
votes
246
views
asked 5 months agolg...
I'm trying to fetch Glue Catalogue tables from Spark on EKS cluster,
added to spark configuration:
```
"spark.hadoop.hive.metastore.client.factory.class":...
1
answers
0
votes
121
views
asked 5 months agolg...
Hi, I was trying to implement a system on AWS. The system has one account A (not root) in an organization.
**Problem**: Account A has an S3 bucket and I need to create a Glue Crawler to read S3...
1
answers
0
votes
318
views
asked 6 months agolg...
After creating my DataZone domain I'm trying to import a new Data Source from glue to publish it to the catalog and I'm getting the following error:
![Enter image description...
2
answers
0
votes
268
views
asked 6 months agolg...
Hello,
I was able to create and register a new Iceberg table in my data catalog and Lake Formation using a Glue Job. I used these methods from the...
1
answers
0
votes
279
views
asked 6 months agolg...
I am trying to have glue data catalog as the hive metastore, stood up the EMR(emr-6.15.0) with the following node classification config per AWS, and it always initialize a default glue catalog...
1
answers
0
votes
488
views
asked 6 months agolg...
Hello,
I am trying to add a column to a data set as part of a transformation in an AWS Glue job. I am developing my script locally using interactive sessions and in my session I can see that the code...
1
answers
0
votes
478
views
asked 6 months agolg...