Questions tagged with AWS Glue
Content language: English
Select up to 5 tags to filter
Sort by most recent
Browse through the questions and answers listed below or filter and sort to narrow down your results.
I am trying to create a Glue job for migrating data from BigQuery to an S3 bucket. I have created a BigQuery connection in AWS Glue. The connection uses the Secret Id to reference a secret name in AWS...
1
answers
0
votes
121
views
asked 2 months agolg...
Getting error while connecting streaming data from kinesis to redshift with few transformations using visual ETL. (using amazon kinesis - glue data catalog table as source ). Schema is already...
1
answers
0
votes
212
views
asked 2 months agolg...
I have created a glue trigger using cdk. My question is how can I deactivate this trigger using CDK. Here is my code -
```
const myTrigger = new CfnTrigger(this,`my-trigger-dev`, {
name:...
1
answers
0
votes
188
views
asked 2 months agolg...
Hello Friends,
I am working on a project that reads data from Dremio data lakehouse solution, I am trying to read the data from one of its schema. Glue does not natively come with the connector, so I...
2
answers
0
votes
183
views
asked 2 months agolg...
We have a Redshift Cluster with DC2 nodes and a Redshift Serveless service running on same AWS account in us-east-1 region.
When trying to query the SVV_EXTERNAL_TABLE view on the Redshift cluster, we...
2
answers
0
votes
239
views
asked 2 months agolg...
Hello, first sorry for my English
We are facing an issue that, returns a time out using the method GetWorkflowRuns boto3, because we have a lot of runs in history
And I'm not finding anything to...
Accepted AnswerAWS Glue
1
answers
0
votes
217
views
asked 2 months agolg...
Actually i uploaded one JSON file into my s3 bucket which is having nested JSON data. and, created Athena table out of it by using glue crawler. after that when i was trying to query the table i am...
0
answers
0
votes
348
views
asked 2 months agolg...
I have an AWS Glue job that transfers data from a PostgreSQL database to Amazon S3. The job functioned efficiently until the size of the data increased. Now, when attempting to save approximately 2-3...
1
answers
0
votes
194
views
asked 2 months agolg...
0
I'm encountering a NoSuchKey error while attempting to create an Athena Iceberg table using AWS Wrangler. Here's the anonymized error message:
{
"errorMessage": "GENERIC_INTERNAL_ERROR:...
0
answers
0
votes
245
views
asked 2 months agolg...
Hello,
I have an AWS Glue job that is only supposed to perform an SQL query on the current status. Unfortunately, I always get the following error: "Error Category: QUERY_ERROR; AnalysisException:...
1
answers
0
votes
288
views
asked 2 months agolg...
Question:
We currently have approximately 100 tables in delta format, partitioned by yyyy, mm, dd, hh, mm. Our current process involves reading these delta tables via a crawler, cataloging them, and...
0
answers
0
votes
366
views
asked 2 months agolg...
Reading few gb say 15gb of parquet skewed data , after few transformation such as data type change for some columns and then doing repartitions (dataframe.repartition(120)) before writing it to s3 in...
1
answers
0
votes
298
views
asked 2 months agolg...