Unanswered Questions tagged with AWS Glue
Content language: English
Select up to 5 tags to filter
Sort by most recent
Browse through the questions and answers listed below or filter and sort to narrow down your results.
I am looking to ingest upstream files via Glue ETL and I need to match misspellings to existing, already standardized data, based on rules that I can either continually add to or train a model to...
0
answers
0
votes
65
views
asked 2 years agolg...
Dear GlueCommunity,
I'm using PySpark with AWS Glue for a large ETL job. Most of my source data sit in an AWS RDS Postgres instance. I read all my tables directly with...
0
answers
0
votes
111
views
asked 2 years agolg...
As the documentation mentions, https://docs.aws.amazon.com/glue/latest/dg/developing-blueprints-code-classes.html#developing-blueprints-code-jobclass, Glue Blueprints on a Blueprint run create Jobs...
0
answers
0
votes
48
views
asked 2 years agolg...
Do we have AWS glue schema registry replication story? We can't set up the redundancy by ourselves because it would have a different schema version.
This is important for us in terms of business...
0
answers
0
votes
177
views
asked 2 years agolg...
I am new to AWS and exploring Athena for querying S3 objects. I am using AWS Glue Crawler for data catalog.
I have successfully created table using Crawler for my JSON files available on the S3...
0
answers
0
votes
122
views
asked 2 years agolg...
I want to be able to dynamically pass credentials to glue when it creates the dynamic frame with glueContext.create_dynamic_frame.from_options with connection type "s3", the problem I don't know where...
0
answers
0
votes
101
views
asked 2 years agolg...
Hi everyone,
Since a few days I have problems with Glue, I can not run any Glue Studio notebook and I always get this exception:
Exception encountered while creating session: An error occurred...
0
answers
1
votes
120
views
asked 2 years agolg...
I have a parquet file from which amongst all the columns of data, I have one shown as BigDecimal, which is a format that is not included in AWS. I would like to format it as `decimal(38,18)`, but it...
0
answers
0
votes
87
views
asked 2 years agolg...
I'm trying to do a very basic transformation of a CSV in S3 to a parquet file using Glue. Whenever I set the job to run, it fails almost immediately with the error in the title. I have increased the...
0
answers
0
votes
278
views
asked 2 years agolg...
When using Glue's Filter transformation, the resulting DynamicFrame is empty and the schema is also lost for some reason. This is resulting in an error in subsequent steps in my flow. Is there any way...
0
answers
0
votes
129
views
asked 2 years agolg...
I have this code to write in Redsfhit
```
dinamycFrame = DynamicFrame.fromDF(df, glueContext, df)
try:
glueContext.write_dynamic_frame.from_jdbc_conf(frame = dinamycFrame,
...
0
answers
0
votes
96
views
I have the following JSON data, which I would like to parse as individual records:
```
[{
"Application": 0,
"BaselineSetName": "",
"CompareToSetName": "",
"Date": 1658500320,
...
0
answers
0
votes
116
views
asked 2 years agolg...