Questions tagged with AWS Glue
Content language: English
Select up to 5 tags to filter
Sort by most recent
Browse through the questions and answers listed below or filter and sort to narrow down your results.
Which service among AWS DMS, AWS Glue and AWS Kinesis is cheap and efficient for replication of large amount data between two AWS account?
My main focus is to lower the cost for replication of...
2
answers
0
votes
661
views
asked 5 months agolg...
I am trying to load geopandas library in Glue job , I have tried below approaches.
1. Creating geopandas python wheel and adding it Job Details -->Libraries-->Python library...
2
answers
0
votes
151
views
asked 5 months agolg...
Hi folks!
right now i'm working on project to do ETL Process using AWS Glue. I already create the query script to process the data, but my source data is in Json format. I need help to transform the...
1
answers
0
votes
262
views
asked 5 months agolg...
When creating a QuickSight Dataset using CDK, we have to specify the input_columns parameter for physical_table_map. Is there a way to include all columns in the table without having to write out all...
1
answers
0
votes
444
views
asked 5 months agolg...
Hello... I have a query regarding the conversion of Protobuf objects stored in an S3 bucket (I possess a list of .pb.gz objects within the "Origin" bucket). I aim to develop a Glue job to transform...
2
answers
0
votes
183
views
asked 5 months agolg...
Hello!
I am using Redshift Serverless and am having some difficulty with auto-complete. This understandably leads to tedious typing of queries and introduces unneeded typos.
We have several...
1
answers
0
votes
458
views
asked 5 months agolg...
This is a followup question to the post https://repost.aws/questions/QUzURnlUzOR9mfoQbiLwCNvA/incremental-data-capture-from-dynamodb-to-s3
With PITR feature in DDB, is it possible to incrementally...
1
answers
0
votes
537
views
asked 5 months agolg...
I am running a Glue ETL job to load data from parquet file from S3 into Redshift table.
![Enter image description here](/media/postImages/original/IMrrvRKNfNQ0604h-FuKYtFQ)
I am able to get data...
2
answers
0
votes
327
views
asked 5 months agolg...
I am facing an error in my glue job while accessing the huge volume of data from the source[Aurora MySQl].
```
[Error] The table '/rdsdbdata/tmp/#sql104_24f40a_0' is full
```
I want to know the root...
1
answers
0
votes
354
views
asked 5 months agolg...
I have uploaded two separate csv files (just to check the query results) with the tables in the right order and values in S3, but everytime I run the crawler and view the individual table data in...
1
answers
0
votes
234
views
asked 5 months agolg...
I'm trying to fetch Glue Catalogue tables from Spark on EKS cluster,
added to spark configuration:
```
"spark.hadoop.hive.metastore.client.factory.class":...
1
answers
0
votes
107
views
asked 5 months agolg...
Hi, I was trying to implement a system on AWS. The system has one account A (not root) in an organization.
**Problem**: Account A has an S3 bucket and I need to create a Glue Crawler to read S3...
1
answers
0
votes
301
views
asked 5 months agolg...