Questions tagged with AWS Glue
Content language: English
Select up to 5 tags to filter
Sort by most recent
Browse through the questions and answers listed below or filter and sort to narrow down your results.
I am using AWS Glue 4.0 (Pyspark) to get data from several MongoDB Atlas collections, using the GlueContext.create_dynamic_frame.from_options method. For all collections except one it has worked fine...
2
answers
0
votes
160
views
asked 3 months agolg...
Loading class `com.mysql.jdbc.Driver'. This is deprecated. The new driver class is `com.mysql.cj.jdbc.Driver'. The driver is automatically registered via the SPI and manual loading of the driver class...
1
answers
0
votes
289
views
asked 3 months agolg...
ERROR StatusLogger Unrecognized conversion specifier [n] starting at position 56 in conversion pattern.
Note: i have already created s3 endpoint in same vpc i am currently working on, also created...
1
answers
0
votes
226
views
asked 3 months agolg...
Hi AWS, I was querying Cost and Usage Reports (CURs) using Athena. By default a CloudFormation template gets created and it gets stored inside the bucket where the report is getting stored, however...
1
answers
0
votes
1021
views
asked 3 months agolg...
I am wondering what is the best way to pull data front external APIs using AWS services to store it in S3, dynamodb or RDS in a periodic way.
Is it lambda? Glue? Eventbridge? Appflow with custom...
2
answers
0
votes
332
views
asked 3 months agolg...
When other AWS users are trying to access my bucket with their crawler, they are getting the below error.
"Crawler Error:
User does not have access to target s3://test-bucket-mis6389/evdata/"
My s3...
5
answers
0
votes
535
views
asked 3 months agolg...
I need to replicate an iceberg datalake stored in S3 from one bucket to another. However, multi-region access point doesn't work with Athena table. And I don't see any pyspark procedure that could...
1
answers
0
votes
444
views
asked 3 months agolg...
When creating a table with a leading space in the name, AWS Glue does not display any error during the creation process. However, upon checking the API logs, I noticed that the space is present in the...
1
answers
0
votes
468
views
asked 3 months agolg...
Hello,
I new at glue and created a job to extract the content on a table in oracle (on premise) to S3, the oracle conection is sucessfull but whe trying to write to S3 it says:
An error occurred...
4
answers
0
votes
134
views
asked 3 months agolg...
I need to fetch files that has arrived current_time - 1hr from my S3 bucket for processing. My files name will be in format yyyymmdd-hhmmsssss.parquet (includes milli seconds also). So I am running a...
1
answers
0
votes
442
views
asked 3 months agolg...
Hello AWS Support and Forum,
basic free tier account for some unknown reason. I've tried different regions and I still get the same 'AccessDeniedException: Account id... is denied access.' error! for...
2
answers
0
votes
155
views
asked 3 months agolg...
In the AWS console, we can see if a crawler run returned with changes in schema for particular tables:
![crawler ui](/media/postImages/original/IMVS_OmxwOTayK7TSm0yA_6g)
If I were to click on where...
1
answers
0
votes
462
views
asked 3 months agolg...