Skip to content

All Content tagged with AWS Glue

AWS Glue is a serverless data integration service that makes it easy to discover, prepare, and combine data for analytics, machine learning, and application development.

Content language: English

Filter content
Select tags to filter
Sort by
Sort by most recent
2179 results
This article explains how to use Lake Formation tag-based access control (LF-TBAC) to automate permissions management at scale for data mesh architectures.
I have successfully used RDS zeroetl to synchronize Mysql tables to our provisioned Redshift cluster. The Redshift cluster is a single instance ra3.large configuration with the required parameter grou...
2
answers
0
votes
9
views

asked 3 days ago

Evaluate the breaking changes that apply to your AWS Glue jobs before you upgrade to Glue version 5.0 or 5.1.
AWS Glue
I'm posting here because I've exhausted standard free-tier support channels with no resolution after 20+ days. I'm hoping AWS staff or community members can point me toward the right path. **Account ...
1
answers
-1
votes
58
views

asked 21 days ago

I am currently setting up a Zero-ETL integration pipeline from DynamoDB to S3 using AWS Glue in the ap-northeast-1 region and I am experiencing a data duplication issue during the CDC (Change Data Cap...
2
answers
0
votes
55
views

asked 24 days ago

I want to Trigger a lambda Function when my Zero-ETL Salesforce integration complete for all objects. This lambda function will trigger a dbt workflow in github that will use the synced data in Snowfl...
1
answers
0
votes
44
views

asked a month ago

I'm trying to use a REST API connection in one of my Glue jobs to test out the feature but I keep getting this error during the data preview and when I run the ETL job: **Cannot invoke "String.toUpper...
1
answers
0
votes
29
views

asked a month ago

We received an AWS Health notification for AWS SDK for Java 1.x usage in us-east-2. After investigation, the usage appears related to AWS Glue managed runtime: - Glue version 5.0 - Spark 3.5 / Python...
2
answers
1
votes
283
views

asked 2 months ago

Customers using Snowflake's Workload Identity Federation (WIF) with AWS Glue may encounter a "No AWS region was found" error because the Glue proxy layer blocks boto3's automatic region detection. Thi...
Is Lake Formation credential vending through the Glue Iceberg REST endpoint (`https://glue.<region>.amazonaws.com/iceberg`) supported for AWS Lambda execution roles when reading and writing S3 Tables?...
1
answers
1
votes
162
views

asked 2 months ago

Running Spark on EMR with KMS-encrypted S3 data? Every object read triggers a kms:Decrypt API call — and at scale, those costs add up fast. If your compliance requirements prevent switching to S3 Buck...
PROBLEM AWS Glue Data Quality standalone evaluation runs (Data Catalog-based, not embedded in ETL) fail with AccessDeniedException from Lake Formation when accessing an Iceberg table after removing I...
1
answers
0
votes
66
views

asked 3 months ago

  • 1
  • 2
  • 3
  • 4
  • 5
  • •••
  • 182
  • Page size
    12 / page