Glue Job - how to read from jdbc redshift tables in parallel?

0

In the aws documnet

https://docs.aws.amazon.com/glue/latest/dg/run-jdbc-parallel-read-job.html In reading from jdbc tables in parallel it's properties are ignored at redshift.

therfore, how to read from jdbc redshift tables in parallel? Is there anyone who knows?

Topics

Analytics Database

Tags

AWS Glue Extract Transform & Load Data Amazon Redshift

Language

English

AWS-User-5187120

asked 2 years ago651 views

1 Answer

Newest
Most votes
Most comments

Are these answers helpful? Upvote the correct answer to help the community benefit from your knowledge.

0

Using DynamicFrames will utilize COPY/UNLOAD behind the scenes which are executed in parallel.

https://docs.aws.amazon.com/glue/latest/dg/aws-glue-programming-etl-redshift.html

answered 2 years ago

Relevant content

How do you read from a postgres table (or other system via JDBC) using Glue and Spark?
Jaime
asked a year ago
AWS Glue Job Redshift : Issue Reading Timestamp with timezone from Redshift in AWS Glue Jobs
AWS-User-6422649
asked 3 years ago
Parallelize writing to Iceberg tables in Glue
ThomasMueller
asked a year ago
Read the input file name from S3 in AWS Glue into redshift
Joe
asked 5 months ago
How can I set up a cross-account AWS Glue job for JDBC resources?
AWS OFFICIALUpdated 2 years ago
Why does my AWS Glue job fail with lost nodes when I migrate a large data set from Amazon RDS to Amazon S3?
AWS OFFICIALUpdated 2 years ago
How do I optimize my AWS Glue ETL workloads when reading from or writing to Amazon DynamoDB?
AWS OFFICIALUpdated 3 years ago
How do I run SQL commands on an Amazon Redshift table before or after writing data in an AWS Glue job?
AWS OFFICIALUpdated 2 years ago
AWS Glue Dynamic Frame – JDBC Performance Tuning Configuration
EXPERT
AWSRB
published a year ago
Amazon Redshift adds compression support in the ODBC and JDBC drivers
EXPERT
Raza
published 6 months ago