Unanswered Questions tagged with AWS Glue
Content language: English
Select up to 5 tags to filter
Sort by most recent
Browse through the questions and answers listed below or filter and sort to narrow down your results.
when I launch an aws GLUE crawler on files in CSV format, the crawler does not detect some files as CSV, in stackoverflow I read that it is because the crawler uses LazySimpleSerde and needs at least...
0
answers
0
votes
112
views
I have set up and am using the Spark history server for AWS Glue as described here:
https://docs.aws.amazon.com/glue/latest/dg/monitor-spark-ui-history.html
However, this application is not able to...
0
answers
0
votes
70
views
asked 7 months agolg...
Hi Team,
I have setup CUR via Billing Export to s3 and querying data in Athena via AWS Glue Crawler. I did few transformations via AWS Glue ETL and want to store the transformed data incrementally to...
0
answers
0
votes
669
views
asked 7 months agolg...
Since a day before yesterday, AWS Glue Studio appears do not working anymore.
Looking at javascript console error I found this:
![javascript...
0
answers
0
votes
25
views
asked 7 months agolg...
curious has anyone done a baseline comparison of cost/performance (using same dataset and spark transformations) b/w SageMaker Processing Job (Spark container) vs an AWS Glue Job (Spark) ?
Looking at...
0
answers
0
votes
75
views
asked 7 months agolg...
I created an Athena table using Glue
```
import * as glue from '@aws-cdk/aws-glue-alpha'
const dataWarehouse = new glue.Table(this, `data_warehouse`, {
database: db,
tableName:...
0
answers
0
votes
88
views
asked 8 months agolg...
A few days ago jobs list is completely disapperared.
Google Chrome with last updates, Macbook Intel i9 with last updates (Sonoma).
I tried to clear cache, cookies, login from Incognito mode, disable...
0
answers
0
votes
89
views
asked 8 months agolg...
I am using Glue Crawler to crawl for parquet files, partitioned by type/yyyy/mm/dd which has been working just great. However, we have just run into a scenario where we need to rename a column. Is it...
0
answers
0
votes
122
views
asked 8 months agolg...
My Glue 4.0 jobs have suddenly stopped working with error message below. As it is related to boto3, I am unable to make any changes to library config. Pls advise.
NB: I noticed that urllib3 released...
0
answers
0
votes
100
views
asked 8 months agolg...
There are two types of use cases for the CustomSQL rule. In my case, I want to use a rule of the Custom SQL to retrieve row-level results type. For example: CustomSql "select Name from primary where...
0
answers
0
votes
60
views
asked 8 months agolg...
I was trying to perform Glue ETL transformation and store it in AWS Serverless Redshift database and S3 (both) . However, even the Console generated PySpark sheet fails. Almost none of the methods...
0
answers
0
votes
162
views
asked 8 months agolg...
I am trying to connect AWS Glue Catalog to Redshift, but, I keep getting this error
`An error occurred while calling o86.getSink. The connection attempt failed`
In the logs (a part of it)
File...
0
answers
0
votes
179
views
asked 8 months agolg...