Questions tagged with AWS Glue
Content language: English
Select up to 5 tags to filter
Sort by most recent
Browse through the questions and answers listed below or filter and sort to narrow down your results.
I am crawling data from S3. The data are stored in CSV form. This is how the directory looks like:
S3 Bucket
- logs
- north_america
- year=2024/
- europe
-...
0
answers
0
votes
12
views
asked 3 hours agolg...
We would need to transfer the data from the firehose to parquet format using Glue and the final destination is to store in S3.
Access was denied when assuming role. Please ensure that the role...
1
answers
0
votes
36
views
asked 4 hours agolg...
Hi
I am experimenting with a task about the "medaillon pattern".
I have three folder in one S3 bucket:
raw
silver
gold
and two Glue jobs:
- raw_to_silver which copies a couple of files from raw to...
0
answers
0
votes
48
views
asked 9 hours agolg...
I keep getting this error, Error Category: UNCLASSIFIED_ERROR; An error occurred while calling o106.getDynamicFrame. Invalid connection string
But the connection string looks fine, looks identical to...
1
answers
0
votes
120
views
asked 4 days agolg...
I have csv files stored in S3. The files are named as followed: {region name}_{today's date}.csv. There are multiple regions. These files are saved under 'log/year/month/date' directory. So this...
1
answers
0
votes
53
views
asked 4 days agolg...
I have Excel sheets with multiple sheets on it stored in S3. Currently, I have separate csv files for each sheet, and crawling from each csv files. Instead of doing this, I would like to crawl from...
1
answers
0
votes
49
views
asked 4 days agolg...
Is there a way for the crawler to generate multiple metadata? I have multiple files that contains region names. I want to generate separate metatables for each regions. Is there a way a crawler can...
1
answers
0
votes
71
views
asked 5 days agolg...
I am keeping track of some data, based on the date on S3. The files are stored in directories like this: year=yyyy/month=mm/day=dd and inside this directory, there are multiple csv files. I want a...
1
answers
0
votes
73
views
asked 5 days agolg...
I'm trying to run a Python script in aws glue that uses athena.get_query_runtime_statistics when I run i on my local machine the script works, but running at glue returns this error
0
answers
0
votes
76
views
asked 7 days agolg...
I setup a job using Glue visual, connect to the appropriate table in Oracle, and the data appears to be selected perfectly from the source:
![Data looks...
0
answers
0
votes
88
views
asked 7 days agolg...
Hi,
I'm getting started at AWS Glue and developing my first ETL. While doing that, I'm testing the FillMissingValues step and getting this error.
![Enter image description...
Accepted AnswerAWS Glue
1
answers
0
votes
95
views
asked 7 days agolg...
I'd be grateful for a clue on how to craft a connection string for AWS Glue to connect to a SQL Server Always on AG using the Microsoft JDBC Drivers. I'm trying to use this bring your own driver...
2
answers
0
votes
197
views
asked 10 days agolg...