Questions tagged with AWS Glue
Content language: English
Select up to 5 tags to filter
Sort by most recent
Browse through the questions and answers listed below or filter and sort to narrow down your results.
I've imported a dataset of JSON objects that all have consistent schema. Glue crawler finished successfully and created a table. I can select * with a limit in Athena, but when I select all rows I get...
0
answers
0
votes
12
views
asked 4 hours agolg...
trying out AWS glue for the first time. i want to read some data from s3 and push it to some database in a database within aws. what resources , do i need to create/provision for AWS glue, if doing...
1
answers
0
votes
29
views
asked 10 hours agolg...
Hello, I am attempting to update a glue job default argument within a lambda function.
So far the best I have been able to find is to use the boto3 get_job and update_job functions with the desired...
1
answers
0
votes
36
views
asked 13 hours agolg...
In our ETL process we are building out a pipeline where someones job is to take input files (ex. csv) and map the columns to existing column names. After the mapping is complete a glue workflow will...
0
answers
0
votes
35
views
asked 17 hours agolg...
Hi!
I am trying to use DataZone to share an Iceberg table from the Glue Data Catalog with another AWS account.
I have created the table with Athena in the source account like this:
```sql
CREATE...
0
answers
0
votes
25
views
asked 20 hours agolg...
I am trying to create glue crawler for reading data from my s3 bucket but i am getting access denied error each time. I have tried using IAM user and root user as well. I am stuck in this issue. Can...
1
answers
0
votes
53
views
asked a day agolg...
![Enter image description here](/media/postImages/original/IMBuRkn9W7QT6CvwJB2m8InA)
Hello AWS Community,
I'm encountering an issue while attempting to extract a specific value from a column in AWS...
0
answers
0
votes
21
views
asked a day agolg...
I was working on the Glue console creating a job in the Visual Editor and then running the job. The next day I saw that I had been billed for interactive session usage and looking at the list of...
1
answers
0
votes
29
views
asked 2 days agolg...
Why don't I see the column - ruleset_name, in the output of s3 file generated by a Glue Data Quality job ? I see the below columns in the JSON output of the Glue DQ job. Is there any way, I can get...
0
answers
0
votes
91
views
asked 5 days agolg...
AWS Glue Python Shell currently supports Python 3.9, whereas AWS Glue Pyspark jobs support Python 3.10 and AWS Lambda up to 3.12. When will we see support for more recent Python runtimes in the AWS...
0
answers
0
votes
84
views
asked 5 days agolg...
I am reading multiple files from S3 and writing the output to Redshift DB. Below is my code to read all the files from a S3 location (s3://abc/oms/YFS_CATEGORY_ITEM/)
```
yfs_category_item_df =...
2
answers
0
votes
333
views
asked 6 days agolg...
Bug Report: Glue task-oriented landing page annoying prompt, annoying redirection from breadcrumbslg...
new task oriented landing page causes annoying prompt every page load, and an even more annoying redirection every time I click on a breadcrumb link.
I visit the AWS Glue page, and see the new...
1
answers
0
votes
119
views
asked 7 days agolg...