Unanswered Questions tagged with AWS Glue
Content language: English
Select up to 5 tags to filter
Sort by most recent
Browse through the questions and answers listed below or filter and sort to narrow down your results.
I'm trying to update an existing AWS Glue Crawler for a DocumentDB instance. Given that it won't take a wildcard to add all the collections to the crawler I'm looking for an easy way to add several...
0
answers
0
votes
40
views
asked 9 months agolg...
Hello, we have an S3 bucket with various CSV files and an AWS Glue crawler to update the Data Catalog and finally an AWS Glue job to move the data to RedShift. The handling of data and target table is...
0
answers
0
votes
128
views
asked 9 months agolg...
I've got Athena setup to query a DocumentDB instance with the Lambda function built and AWS Glue configured. The setup was done through the datasource connector for DocumentDB.
I can see the database...
0
answers
0
votes
178
views
asked 9 months agolg...
Hello everyone.
Data from the rest api in the form of JSON is loaded daily by lambda into s3-bucket-1.
Then this data should be stored in s3-bucket-2 in the form of a flat parquet table.
I did it in...
0
answers
0
votes
73
views
asked 9 months agolg...
Hi,
Has anyone manage to make the Delta-Spark python package work with Glue interactive session? It works when I submit Glue 4.0 job but not on interactive session. Below are a few code snippets that...
0
answers
0
votes
50
views
asked 9 months agolg...
Hi Team,
I am using below code and its giving me the columns from the data, but my expectation to get the columns from Glue Data Catalog.
glueContext.create_dynamic_frame.from_catalog(database =...
0
answers
0
votes
88
views
asked 10 months agolg...
Are there any known, recently (~07/18/2023) introduced performance issues with Glue crawlers?
We have recently observed excessive slowness with Glue crawlers that had been running for months without...
0
answers
0
votes
28
views
asked 10 months agolg...
I'm trying to create a Glue Crawler with the default IAM role that Glue creates in the process, but when I click "Create crawler" it shows the error message at the...
0
answers
0
votes
78
views
asked 10 months agolg...
I read data from s3 using as follow.
```
sec_id_dyf = glueContext.create_dynamic_frame.from_options(
connection_type = 's3',
...
0
answers
0
votes
98
views
asked 10 months agolg...
Hello,
I am experience an issue when trying to use the Glue ETL on one of tables in my data catalogue. I am using the visual tool with a very simple SQL transformation on the table and when clicking...
0
answers
0
votes
91
views
asked 10 months agolg...
I have an issue with **Glue Job **running from docker image amazon/aws-glue-libs:glue_libs_4.0.0_image_01 while "**MERGE INTO**" **ICEBERG** table.
I follow the instruction from...
0
answers
0
votes
167
views
asked 10 months agolg...
I am using AWS Glue for data ETL to load data from MySQL into Redshift.
In MySQL, the types of the three columns, type, sub_type, and status, are all unsigned int.
However, when stored in Redshift,...
0
answers
0
votes
52
views
asked a year agolg...