Questions tagged with AWS Glue
Content language: English
Select up to 5 tags to filter
Sort by most recent
Browse through the questions and answers listed below or filter and sort to narrow down your results.
I have uploaded two separate csv files (just to check the query results) with the tables in the right order and values in S3, but everytime I run the crawler and view the individual table data in...
1
answers
0
votes
239
views
asked 5 months agolg...
I'm trying to fetch Glue Catalogue tables from Spark on EKS cluster,
added to spark configuration:
```
"spark.hadoop.hive.metastore.client.factory.class":...
1
answers
0
votes
118
views
asked 5 months agolg...
Hi, I was trying to implement a system on AWS. The system has one account A (not root) in an organization.
**Problem**: Account A has an S3 bucket and I need to create a Glue Crawler to read S3...
1
answers
0
votes
313
views
asked 5 months agolg...
After creating my DataZone domain I'm trying to import a new Data Source from glue to publish it to the catalog and I'm getting the following error:
![Enter image description...
2
answers
0
votes
262
views
asked 5 months agolg...
Hello,
I was able to create and register a new Iceberg table in my data catalog and Lake Formation using a Glue Job. I used these methods from the...
1
answers
0
votes
276
views
asked 5 months agolg...
I am trying to have glue data catalog as the hive metastore, stood up the EMR(emr-6.15.0) with the following node classification config per AWS, and it always initialize a default glue catalog...
1
answers
0
votes
481
views
asked 5 months agolg...
Hello,
I am trying to add a column to a data set as part of a transformation in an AWS Glue job. I am developing my script locally using interactive sessions and in my session I can see that the code...
1
answers
0
votes
460
views
asked 6 months agolg...
We are exploring AWS Glue for our use case implementation. It's a great tool for ETL Jobs.
However, when supporting the complex transformations......... GUI editor is not supporting it and switched...
1
answers
0
votes
173
views
asked 6 months agolg...
In a Glue streaming job, is it possible read from Multiple Kinesis sources in my spark script?
something like:
```
streams = ["streamA", "streamB"]
for stream in streams:
...
3
answers
0
votes
675
views
asked 6 months agolg...
I'm trying to run glue job that join 3 mysql tables as data source and insert that data into redshift as data target, but facing this error that says
"Error Category: UNCLASSIFIED_ERROR; An error...
1
answers
0
votes
1407
views
asked 6 months agolg...
When a view is created by running an Athena SQL query, it appears in the Glue catalog but errors are raised when querying the view in a Glue job or a Glue Spark context.
I am able to make the view...
1
answers
0
votes
366
views
asked 6 months agolg...
Hi all, I am trying to implement lake formation security on my data lake consisting of bronze, silver, gold zones in s3 and glue catalog tables. The gold zone data also exists in redshift tables with...
1
answers
0
votes
385
views
asked 6 months agolg...