Unanswered Questions tagged with AWS Glue
Content language: English
Select up to 5 tags to filter
Sort by most recent
Browse through the questions and answers listed below or filter and sort to narrow down your results.
Hello everyone.
Data from the rest api in the form of JSON is loaded daily by lambda into s3-bucket-1.
Then this data should be stored in s3-bucket-2 in the form of a flat parquet table.
I did it in...
0
answers
0
votes
82
views
asked 10 months agolg...
Hi,
Has anyone manage to make the Delta-Spark python package work with Glue interactive session? It works when I submit Glue 4.0 job but not on interactive session. Below are a few code snippets that...
0
answers
0
votes
54
views
asked 10 months agolg...
Hi Team,
I am using below code and its giving me the columns from the data, but my expectation to get the columns from Glue Data Catalog.
glueContext.create_dynamic_frame.from_catalog(database =...
0
answers
0
votes
97
views
asked 10 months agolg...
Are there any known, recently (~07/18/2023) introduced performance issues with Glue crawlers?
We have recently observed excessive slowness with Glue crawlers that had been running for months without...
0
answers
0
votes
29
views
asked 10 months agolg...
I'm trying to create a Glue Crawler with the default IAM role that Glue creates in the process, but when I click "Create crawler" it shows the error message at the...
0
answers
0
votes
88
views
asked a year agolg...
I read data from s3 using as follow.
```
sec_id_dyf = glueContext.create_dynamic_frame.from_options(
connection_type = 's3',
...
0
answers
0
votes
105
views
asked a year agolg...
Hello,
I am experience an issue when trying to use the Glue ETL on one of tables in my data catalogue. I am using the visual tool with a very simple SQL transformation on the table and when clicking...
0
answers
0
votes
95
views
asked a year agolg...
I have an issue with **Glue Job **running from docker image amazon/aws-glue-libs:glue_libs_4.0.0_image_01 while "**MERGE INTO**" **ICEBERG** table.
I follow the instruction from...
0
answers
0
votes
168
views
asked a year agolg...
I am using AWS Glue for data ETL to load data from MySQL into Redshift.
In MySQL, the types of the three columns, type, sub_type, and status, are all unsigned int.
However, when stored in Redshift,...
0
answers
0
votes
60
views
asked a year agolg...
Hi,
1. I have prepared the correct connection to Snowflake in AWS Glue. According to the instructions from...
0
answers
0
votes
160
views
asked a year agolg...
I am using Data Quality to evaluate the dataset and I am routing the failed rules and failed records. But when i check the s3 bucket for the failed records i am seeing empty files along with the...
0
answers
0
votes
123
views
asked a year agolg...
When Glue table is created in CDK V2, AWS Athena can not SHOW CREATE TABLE over it.
`[ErrorCategory:USER_ERROR, ErrorCode:DDL_FAILED], Detail:FAILED: Execution Error, return code 1 from...
0
answers
0
votes
103
views
asked a year agolg...