Unanswered Questions tagged with Extract Transform & Load Data
Content language: English
Select up to 5 tags to filter
Sort by most recent
Browse through the questions and answers listed below or filter and sort to narrow down your results.
Dear GlueCommunity,
I'm using PySpark with AWS Glue for a large ETL job. Most of my source data sit in an AWS RDS Postgres instance. I read all my tables directly with...
0
answers
0
votes
95
views
asked 2 years agolg...
I have a parquet file from which amongst all the columns of data, I have one shown as BigDecimal, which is a format that is not included in AWS. I would like to format it as `decimal(38,18)`, but it...
0
answers
0
votes
83
views
asked 2 years agolg...
I'm trying to do a very basic transformation of a CSV in S3 to a parquet file using Glue. Whenever I set the job to run, it fails almost immediately with the error in the title. I have increased the...
0
answers
0
votes
268
views
asked 2 years agolg...
When using Glue's Filter transformation, the resulting DynamicFrame is empty and the schema is also lost for some reason. This is resulting in an error in subsequent steps in my flow. Is there any way...
0
answers
0
votes
121
views
asked 2 years agolg...
We have incoming file with the fixed length field length (.dat).
For example:
|2|123 |AWS |0505 |3
When Glue Crawler crawles the file, it ignores all the int/long values that have trailing...
0
answers
0
votes
127
views
asked 2 years agolg...
SYNTAX_ERROR: line 1:8: SELECT * not allowed from relation that has no columns
I got the above error while trying to preview my created table created with AWS Glue Crawler. The file is my test data...
0
answers
0
votes
149
views
asked 2 years agolg...
I need to share a workflow that has an EventBridge trigger. **[Glue Blueprint doesn't seem to be an option right now as it doesn't support EventBridge...
0
answers
0
votes
84
views
asked 2 years agolg...
An architectural mismatch has often led to issue like -
When trying to connect through a dotnet application it fails with the following error message: "ERROR [01000] [unixODBC][Driver Manager]Can't...
0
answers
0
votes
185
views
asked 2 years agolg...
While running AWS glue Job facing this error
0
answers
0
votes
48
views
asked 2 years agolg...
I need to pre-process some data on S3 before the Glue Crawler crawls the data. For this I created an S3 Object Lambda to do the pre-processing. If I test the Object Lambda using the CLI, it provides...
0
answers
1
votes
176
views
asked 2 years agolg...
In the [documentation](https://docs.aws.amazon.com/glue/latest/dg/aws-glue-programming-python-libraries.html) I can see that we can add additional modules from pip using the following...
0
answers
0
votes
80
views
asked 2 years agolg...
Hello,
Currently I am trying to read csv files in my s3 bucket with the following format:
```
header 1, header 2, header 3
value 1, value 2, value 3
header 1, header 2, header 3, header 4
value 1,...
0
answers
1
votes
133
views
asked 2 years agolg...