Questions tagged with AWS Glue
Content language: English
Select up to 5 tags to filter
Sort by most recent
Browse through the questions and answers listed below or filter and sort to narrow down your results.
I'm converting my json files with dynamic schema to Parquet and used a Glue Crawler to create Glue Table to query using Athena. I got the below error as one column in my table got array<string> in one...
2
answers
0
votes
395
views
asked 5 months agolg...
I have a strange problem.
I created my first Visual ETL job; it runs fine, but there are a few mistakes in the output schema.
The problem is now when I try to open the job, it will not load in...
2
answers
0
votes
349
views
asked 5 months agolg...
Hi folks!
I want to ask can we do insert-update in AWS Glue Visual ETL Job?
I want to use Postgre as DB target and will do insert-update.
Prefers use Visual ETL Job...
1
answers
0
votes
424
views
asked 5 months agolg...
Which service among AWS DMS, AWS Glue and AWS Kinesis is cheap and efficient for replication of large amount data between two AWS account?
My main focus is to lower the cost for replication of...
2
answers
0
votes
669
views
asked 5 months agolg...
I am trying to load geopandas library in Glue job , I have tried below approaches.
1. Creating geopandas python wheel and adding it Job Details -->Libraries-->Python library...
2
answers
0
votes
155
views
asked 5 months agolg...
Hi folks!
right now i'm working on project to do ETL Process using AWS Glue. I already create the query script to process the data, but my source data is in Json format. I need help to transform the...
1
answers
0
votes
279
views
asked 5 months agolg...
When creating a QuickSight Dataset using CDK, we have to specify the input_columns parameter for physical_table_map. Is there a way to include all columns in the table without having to write out all...
1
answers
0
votes
450
views
asked 5 months agolg...
Hello... I have a query regarding the conversion of Protobuf objects stored in an S3 bucket (I possess a list of .pb.gz objects within the "Origin" bucket). I aim to develop a Glue job to transform...
2
answers
0
votes
189
views
asked 5 months agolg...
Hello!
I am using Redshift Serverless and am having some difficulty with auto-complete. This understandably leads to tedious typing of queries and introduces unneeded typos.
We have several...
1
answers
0
votes
474
views
asked 5 months agolg...
This is a followup question to the post https://repost.aws/questions/QUzURnlUzOR9mfoQbiLwCNvA/incremental-data-capture-from-dynamodb-to-s3
With PITR feature in DDB, is it possible to incrementally...
1
answers
0
votes
547
views
asked 5 months agolg...
I am running a Glue ETL job to load data from parquet file from S3 into Redshift table.
![Enter image description here](/media/postImages/original/IMrrvRKNfNQ0604h-FuKYtFQ)
I am able to get data...
2
answers
0
votes
337
views
asked 5 months agolg...
I am facing an error in my glue job while accessing the huge volume of data from the source[Aurora MySQl].
```
[Error] The table '/rdsdbdata/tmp/#sql104_24f40a_0' is full
```
I want to know the root...
1
answers
0
votes
394
views
asked 5 months agolg...