Questions tagged with AWS Glue
Content language: English
Select up to 5 tags to filter
Sort by most recent
Browse through the questions and answers listed below or filter and sort to narrow down your results.
Hi
I am experimenting with a task about the "medaillon pattern".
I have three folder in one S3 bucket:
raw
silver
gold
and two Glue jobs:
- raw_to_silver which copies a couple of files from raw to...
0
answers
0
votes
34
views
asked 4 hours agolg...
I keep getting this error, Error Category: UNCLASSIFIED_ERROR; An error occurred while calling o106.getDynamicFrame. Invalid connection string
But the connection string looks fine, looks identical to...
1
answers
0
votes
115
views
asked 4 days agolg...
I have csv files stored in S3. The files are named as followed: {region name}_{today's date}.csv. There are multiple regions. These files are saved under 'log/year/month/date' directory. So this...
1
answers
0
votes
47
views
asked 4 days agolg...
I have Excel sheets with multiple sheets on it stored in S3. Currently, I have separate csv files for each sheet, and crawling from each csv files. Instead of doing this, I would like to crawl from...
1
answers
0
votes
44
views
asked 4 days agolg...
Is there a way for the crawler to generate multiple metadata? I have multiple files that contains region names. I want to generate separate metatables for each regions. Is there a way a crawler can...
1
answers
0
votes
66
views
asked 5 days agolg...
I am keeping track of some data, based on the date on S3. The files are stored in directories like this: year=yyyy/month=mm/day=dd and inside this directory, there are multiple csv files. I want a...
1
answers
0
votes
66
views
asked 5 days agolg...
I'm trying to run a Python script in aws glue that uses athena.get_query_runtime_statistics when I run i on my local machine the script works, but running at glue returns this error
0
answers
0
votes
70
views
asked 7 days agolg...
I setup a job using Glue visual, connect to the appropriate table in Oracle, and the data appears to be selected perfectly from the source:
![Data looks...
0
answers
0
votes
83
views
asked 7 days agolg...
Hi,
I'm getting started at AWS Glue and developing my first ETL. While doing that, I'm testing the FillMissingValues step and getting this error.
![Enter image description...
Accepted AnswerAWS Glue
1
answers
0
votes
90
views
asked 7 days agolg...
I'd be grateful for a clue on how to craft a connection string for AWS Glue to connect to a SQL Server Always on AG using the Microsoft JDBC Drivers. I'm trying to use this bring your own driver...
2
answers
0
votes
192
views
asked 9 days agolg...
I am trying to add a default to an existing field in an Avro schema in AWS Glue, but the change isn't registering as a new version.
Is this behavior expected? If so, why? If not, how can I go about...
0
answers
0
votes
95
views
asked 10 days agolg...
I have data that I collect from AWS Batch and CloudWatch. I made a lambda function that runs every day that collects those data daily and saves the result to S3. I have a folder called 'logs' and the...
0
answers
0
votes
597
views
asked 11 days agolg...