Redshift vs Redshift Serverless FDW Query & NoETL (RDS Microsoft SQL)

Question

Good Day, 
I need help, please. 
I am setting up a new DW/analytics reporting environment using AWS Airflow with Python and Redshift Serverless
1. For NoETL from RDS PostgreSQL/MySQL to Redshift Serverless, I require clarity on setting up Federated Queries work for the Serverless version for setting up external schema across accounts? (Only find content for Redshift)
2. For NoETL FDW federated query, external schema with RDS Microsoft SQL does not seem to have the option for serverless?

Regards

IC · Accepted Answer

Hi,

1. I found the below link which clarifies Federated queries from Serverless to RDS Source
https://docs.aws.amazon.com/redshift/latest/mgmt/serverless-considerations.html

2. Options on how to Federated Query from Serverless to RDS MS-SQL, I'm really looking for a simple architecture and not multiple ETL for RDS MS-SQL only. Are there upgrades that perhaps occurred on this issue or other ways to query across account from Serverless to RDS MS-SQL?

Regards

Didier_Durand · Answer

Hi,

on your 2., Redshift Serverless has a generic approach (so working also for MS SQL Server) via JDBC drivers across all rdms: see https://docs.aws.amazon.com/redshift/latest/mgmt/serverless-connecting.html

This approach will also solve your 1. though ad hoc connection definition.

Best,

Didier

IC · Answer

Thank You for assisting Didier_Durand

2. Unfortunately, what I meant was that I don't see an FDW option for RDS MS-SQL to setup an external schema with Serverless to source RDS MS-SQL
I am kind of a one-man team and am trying to setup a low code space with AWS Airflow triggering a python script that triggers a redshift Stored Proc for ETL between source & serverless destination.

Please let me know if there are better methods.

Redshift vs Redshift Serverless FDW Query & NoETL (RDS Microsoft SQL)

Relevant content