Unanswered Questions tagged with Extract Transform & Load Data
Content language: English
Select up to 5 tags to filter
Sort by most recent
Browse through the questions and answers listed below or filter and sort to narrow down your results.
I have a parquet file from which amongst all the columns of data, I have one shown as BigDecimal, which is a format that is not included in AWS. I would like to format it as `decimal(38,18)`, but it...
0
answers
0
votes
83
views
asked 2 years agolg...
I'm trying to do a very basic transformation of a CSV in S3 to a parquet file using Glue. Whenever I set the job to run, it fails almost immediately with the error in the title. I have increased the...
0
answers
0
votes
261
views
asked 2 years agolg...
When using Glue's Filter transformation, the resulting DynamicFrame is empty and the schema is also lost for some reason. This is resulting in an error in subsequent steps in my flow. Is there any way...
0
answers
0
votes
119
views
asked 2 years agolg...
We have incoming file with the fixed length field length (.dat).
For example:
|2|123 |AWS |0505 |3
When Glue Crawler crawles the file, it ignores all the int/long values that have trailing...
0
answers
0
votes
127
views
asked 2 years agolg...
SYNTAX_ERROR: line 1:8: SELECT * not allowed from relation that has no columns
I got the above error while trying to preview my created table created with AWS Glue Crawler. The file is my test data...
0
answers
0
votes
147
views
asked 2 years agolg...
I need to share a workflow that has an EventBridge trigger. **[Glue Blueprint doesn't seem to be an option right now as it doesn't support EventBridge...
0
answers
0
votes
81
views
asked 2 years agolg...
An architectural mismatch has often led to issue like -
When trying to connect through a dotnet application it fails with the following error message: "ERROR [01000] [unixODBC][Driver Manager]Can't...
0
answers
0
votes
181
views
asked 2 years agolg...
While running AWS glue Job facing this error
0
answers
0
votes
48
views
asked 2 years agolg...
I need to pre-process some data on S3 before the Glue Crawler crawls the data. For this I created an S3 Object Lambda to do the pre-processing. If I test the Object Lambda using the CLI, it provides...
0
answers
1
votes
170
views
asked 2 years agolg...
In the [documentation](https://docs.aws.amazon.com/glue/latest/dg/aws-glue-programming-python-libraries.html) I can see that we can add additional modules from pip using the following...
0
answers
0
votes
76
views
asked 2 years agolg...
Hello,
Currently I am trying to read csv files in my s3 bucket with the following format:
```
header 1, header 2, header 3
value 1, value 2, value 3
header 1, header 2, header 3, header 4
value 1,...
0
answers
1
votes
129
views
asked 2 years agolg...
Using AWS Pydeequ in databricks I am performing Data Quality checks. When I run this below mentioned code it provide only metrics results as my output (like Check_level, check_status, constraint,...
0
answers
0
votes
159
views
asked 2 years agolg...