Questions tagged with AWS Glue
Content language: English
Select up to 5 tags to filter
Sort by most recent
Browse through the questions and answers listed below or filter and sort to narrow down your results.
Hi,
We send our database old data into S3 in this format:
{table}/year/month/day/asset_id.parquet
so we have a lot of files like...
1
answers
0
votes
390
views
asked 4 months agolg...
I have an existing AWS Glue script that has been successfully running in Glue 2.4 for some time. I went in today to upgrade it to Glue 3.0 and am unable to connect to my database. I am simply reading...
1
answers
0
votes
505
views
asked 4 months agolg...
Running into a time out issue on below scenario
Trying to establish Glue connection from Account B (where my Glue crawler and catalog is) to Account A (Ec2 SQL Server) . Requirement is to pull all...
1
answers
0
votes
174
views
asked 4 months agolg...
I try to create a materialized view based on an external table in the glue data catalog.
Quering the Schema and tables of the data catalog work like expected. Also the creation of normal views...
1
answers
0
votes
367
views
asked 4 months agolg...
Hi,
I am considering Glue to connect to a third party application's database (Oracle) and bring a data set (in excess of 1M rows) obtained by joining multiple tables at source end. The destination...
1
answers
0
votes
363
views
asked 4 months agolg...
Hi all! I need some guidance on the proper way to connect to an Oracle Free Tier Autonomous Database from a Glue ETL Job. I’ve been using the following code snippet, but I encountered an error -...
0
answers
0
votes
622
views
asked 4 months agolg...
* EMR Version: 6.15.0
* Spark Conf
* "spark.sql.catalog.spark_catalog": "org.apache.iceberg.spark.SparkSessionCatalog"
* "spark.sql.catalog.spark_catalog.catalog-impl":...
1
answers
0
votes
286
views
asked 4 months agolg...
I have multiple Visual ETL configured correctly, but if go back to the previous screen and then try to see the job again, the display editor will lost the configuration and it will highlight some...
0
answers
0
votes
109
views
asked 4 months agolg...
I am trying to read data from redshift schema_a and write its output into another redshfit table in schema_b. Below is the code I am using to read from...
3
answers
0
votes
410
views
asked 4 months agolg...
I am working with .sas7bdat file stored in my s3 bucket
I want to convert the sas7bdat file to csv but in glue visual etl I cannot see an option for sas7bdat file format
Can someone please help me...
1
answers
0
votes
322
views
asked 4 months agolg...
Trying to figure out if it's possible to use AWS Glue crawler to parse the spark stderr logs that are dumped from emr-serverless.
The logs are space delimited. I tried running a crawler against the...
0
answers
0
votes
166
views
asked 4 months agolg...
Hello,
While building a job in AWS Glue (Amazon S3, Change Schema, AWS Glue Data Catalog), I had a surprising cost for data preview session (AWS Glue GlueInteractiveSession) of 91% of the total...
1
answers
0
votes
223
views
asked 4 months agolg...