Questions tagged with AWS Glue
AWS Glue is a serverless data integration service that makes it easy to discover, prepare, and combine data for analytics, machine learning, and application development.
Content language: English
Select up to 5 tags to filter
Sort by most recent
Browse through the questions and answers listed below or filter and sort to narrow down your results.
I have below python script in AWS Glue job. For incremental load logic i have now set the Job bookmark option to enable. And then i try to run the glue job again but it did not create any temporary...
We have data stored in Cosmos DB NoSQL and need to migrate it to Snowflake using AWS Glue with a Change Data Capture (CDC) approach.
Our objective is to perform CRUD operations based on CDC to handle...
I am trying to create a Kinesis Firehose stream that can directly write to Iceberg tables in S3. I have defined the Glue Data Catalog in the same account and created a bucket to hold the metadata.
...
asked 2 days ago
Hi Team,
Have a AWS Glue job connection to mongo db atlas . Getting this error ServerSelectionTimeoutError: xyz.mongodb.net:27017: timed out error. How can i resolve this using AWS privatelink and...
Steps taken:
1. Select existing ETL Job (let's call it "sample-job").
2. Clone job.
3. New job created, called "sample-job-copy".
4. Rename job.
5. Hit enter immediately after renaming.
Outcome: New...
We are new to Glue env and dealing with our huge cloud-watch bill, we changed log-level in pyspark script from INFO to ERROR. We are using both python logger and spark logger as below in pyspark (Glue...
I have below Python script where currently it generates several gz files with size 4MB in S3 bucket. Its bydeafult what AWS glue has created. But now i want to create multiple files of a specific size...
I'm using Pretier. EC2 is using t2.micro. I understand about the crawling cost of glue. But I don't understand why the cost of vpc...
Is GitLab running on an organization's host(URL is other than https://gitlab.com/) suported by Git integration in Glue Studio?
Thank you.
Hello.
Is there any Glue API which can create a Glue job with a downloaded JSON code from Glue Studio editor?
Or can the downloaded code only be used to upload to Glue Studio editor manually?
Thank...
I need to execute two commands into an Aurora MySQL database, which has a connection in glue already in place.
The first command is **TRUNCATE TABLE** and the second **LOAD DATA FROM S3** into a...
asked 6 days ago
Good morning,
When creating a crawler with the wizard, the following message is appearing:
One crawler failed to create The following crawler failed to create: "teste-ucs" Here is the most recent...