Whether you're taking your first steps with Kubernetes or you're an experienced practitioner looking to sharpen your skills, our Amazon EKS workshop series delivers practical, real-world experience that moves you forward. Learn directly from AWS solutions architects and EKS specialists through hands-on sessions designed to build your confidence with Kubernetes. Register now and start building with Amazon EKS!
All Content tagged with AWS Glue
AWS Glue is a serverless data integration service that makes it easy to discover, prepare, and combine data for analytics, machine learning, and application development.
Content language: English
Filter content
Select tags to filter
Sort by
Sort by most recent
2145 results
Hi, in AWS docs it is said that data that Glue jobs use is encrypted via KMS keys when it is at rest and in transit, which provides ambiguity since Glue jobs might use S3 instead of their local disk. ...
While using **AWS DataZone Catalog**, I observed an issue with **glossary term navigation from assets**.
### **Observed behavior**
* Assets (e.g., Glue Tables) show associated **Glossary Terms** as ...
I have an IAM role for my bucket that has the following permissions:
"s3:PutObject",
"s3:GetObject",
"iam:PassRole",
"kms:Decrypt",
"kms:Encrypt",
"kms:GenerateDataKey",
"s3:ListBucket",
"s3:DeleteObj...
Masudur Rahaman SayemEXPERT
published 13 days ago0 votes86 views
Production streaming applications across Apache Flink, Spark Streaming, Kafka Streams, Kinesis Client Library and AWS Lambda might experience throttling on AWS Glue Schema Registry's GetSchemaVersion ...
I am attempting to use Hudi 1.1.1 in an AWS 5.0 Glue job. To avoid conflicts with the pre-installed Glue Hudi libraries, I have set the job parameter `--datalake-formats` to an empty string (""). Howe...
rpergaminEXPERT
published 14 days ago1 votes55 views
Apache Iceberg is a leading open table format for analytics. When paired with Kafka Connect, teams can build streaming pipelines into Iceberg tables.
However, a known issue with the Kafka Connect Ice...
Looking to implement sort compaction on an S3 Tables Iceberg table following the blog post:
> [https://aws.amazon.com/blogs/aws/new-improve-apache-iceberg-query-performance-in-amazon-s3-with-sort-and...
asked 19 days ago
I'm using Amazon Kinesis Data Firehose to deliver streaming data into an Apache Iceberg table registered in the AWS Glue Data Catalog, which is part of a non-default catalog (s3tablescatalog/pulse-pro...
I am building a Lakehouse solution using aws glue visual etl. When writing the dataset using the target s3 node in visual editor, there is no option to specify writemode() to overwrite
When i checked ...
shubhranshuEXPERT
published a month ago0 votes117 views
I'm trying to install Python modules in my AWS Glue Python Shell job using wheel files stored in Amazon Simple Storage Service (Amazon S3). My job runs in a private Virtual Private Cloud (VPC) with Am...
We have a large-scale S3 data lake with the following characteristics:
- Source: AWS Flink application writing Parquet files directly to S3
- Volume: ~4000 Parquet files per hour, ranging from 200GB ...
We have glue crawler that runs on a S3 bucket. The bucket contains a single file only. This file get replaced with new data daily. Currently we run glue crawler everytime when this data. After which w...