Unanswered Questions tagged with Extract Transform & Load Data
Content language: English
Select up to 5 tags to filter
Sort by most recent
Browse through the questions and answers listed below or filter and sort to narrow down your results.
Dear AWS re:Post
For my ETL jobs, I read most of my date from RDS, but some I read directly from a table whose data sit on S3.
I only discovered today that each job run generated not insignificant...
0
answers
0
votes
92
views
asked 2 years agolg...
I am trying to modify a PySpark/Glue job to write a DynamicFrame to a new table in Glue Catalog, with a Parquet format.
The database exists, the table does not yet. I am following the instructions...
0
answers
0
votes
145
views
asked 2 years agolg...
**Describe the bug**
Using AWS-CLI (Version: aws-cli/2.8.6 Python/3.9.11 Windows/10 exe/AMD64 prompt/off), starting a Glue Blueprint Run works fine when the number of objects generated inside the...
0
answers
0
votes
58
views
asked 2 years agolg...
We are running an AWS Glue Studio job determine matches between certain products. The Job works very well, however we are unable to add the Confidence score correctly to the output.
The initial...
0
answers
0
votes
73
views
asked 2 years agolg...
Hi,
I'm using Glue with DataBrew for Quicksight and I got this message on quicksight.
> Partition value count does not match the partition column count. (from athena)
So my table is using a column...
0
answers
0
votes
62
views
asked 2 years agolg...
Hi!
I have in **DataBrew a Dataset with dynamic parameterized dataset**s...
0
answers
0
votes
75
views
asked 2 years agolg...
I would like to reference a python parameter of a glue job within the CodeGenConfigurationNodes of create_job() function in boto3 Glue Client.
For instance:
I have an argument `--s3_location` which...
0
answers
0
votes
124
views
asked 2 years agolg...
Hi,
I have a list of json records that's been ingested (daily process), data is crawled, I'd like to output the records individually to S3 objects. i.e. for each unique record, create an S3 object....
0
answers
0
votes
77
views
asked 2 years agolg...
I am trying to add csv files to RDS MySQL database and successfully created my files in Glue Databrew, crawled them in Glue, but when I run my Job in Glue Studio I get an error: "An error occurred...
0
answers
0
votes
225
views
asked 2 years agolg...
In my early steps on the S3, Glue and Athena services, I managed to create a table with Glue, with respect some parquet files in an S3 bucket. Every 30 minutes a new parquet file, with same columns,...
0
answers
0
votes
197
views
asked 2 years agolg...
I have a database that I have been working with and I am trying to add a new table through Glue.
I have been able to create the table and populate data, but I cannot update the partition names in the...
0
answers
1
votes
105
views
asked 2 years agolg...
Error:
HIVE_PARTITION_SCHEMA_MISMATCH: There is a mismatch between the table and partition schemas. The types are incompatible and cannot be coerced. The column 'isfallbackkey' in table...
0
answers
0
votes
209
views
asked 2 years agolg...