Questions tagged with AWS Glue
Content language: English
Select up to 5 tags to filter
Sort by most recent
Browse through the questions and answers listed below or filter and sort to narrow down your results.
I have a strange problem.
I created my first Visual ETL job; it runs fine, but there are a few mistakes in the output schema.
The problem is now when I try to open the job, it will not load in...
2
answers
0
votes
349
views
asked 5 months agolg...
Hi folks!
I want to ask can we do insert-update in AWS Glue Visual ETL Job?
I want to use Postgre as DB target and will do insert-update.
Prefers use Visual ETL Job...
1
answers
0
votes
420
views
asked 5 months agolg...
Which service among AWS DMS, AWS Glue and AWS Kinesis is cheap and efficient for replication of large amount data between two AWS account?
My main focus is to lower the cost for replication of...
2
answers
0
votes
668
views
asked 5 months agolg...
I am trying to load geopandas library in Glue job , I have tried below approaches.
1. Creating geopandas python wheel and adding it Job Details -->Libraries-->Python library...
2
answers
0
votes
154
views
asked 5 months agolg...
Hi folks!
right now i'm working on project to do ETL Process using AWS Glue. I already create the query script to process the data, but my source data is in Json format. I need help to transform the...
1
answers
0
votes
279
views
asked 5 months agolg...
When creating a QuickSight Dataset using CDK, we have to specify the input_columns parameter for physical_table_map. Is there a way to include all columns in the table without having to write out all...
1
answers
0
votes
450
views
asked 5 months agolg...
Hello... I have a query regarding the conversion of Protobuf objects stored in an S3 bucket (I possess a list of .pb.gz objects within the "Origin" bucket). I aim to develop a Glue job to transform...
2
answers
0
votes
188
views
asked 5 months agolg...
Hello!
I am using Redshift Serverless and am having some difficulty with auto-complete. This understandably leads to tedious typing of queries and introduces unneeded typos.
We have several...
1
answers
0
votes
474
views
asked 5 months agolg...
This is a followup question to the post https://repost.aws/questions/QUzURnlUzOR9mfoQbiLwCNvA/incremental-data-capture-from-dynamodb-to-s3
With PITR feature in DDB, is it possible to incrementally...
1
answers
0
votes
546
views
asked 5 months agolg...
I am running a Glue ETL job to load data from parquet file from S3 into Redshift table.
![Enter image description here](/media/postImages/original/IMrrvRKNfNQ0604h-FuKYtFQ)
I am able to get data...
2
answers
0
votes
337
views
asked 5 months agolg...
I am facing an error in my glue job while accessing the huge volume of data from the source[Aurora MySQl].
```
[Error] The table '/rdsdbdata/tmp/#sql104_24f40a_0' is full
```
I want to know the root...
1
answers
0
votes
392
views
asked 5 months agolg...
I have uploaded two separate csv files (just to check the query results) with the tables in the right order and values in S3, but everytime I run the crawler and view the individual table data in...
1
answers
0
votes
238
views
asked 5 months agolg...