By using AWS re:Post, you agree to the AWS re:Post Terms of Use
AWS re:Postre:Post

Incremental Copy of RDS Aurora MySql Table to RedShift

0

Hi!!!

To copy/incrementally copy data from Aurora MySql 5.7 to RedShift, can anyone share implementation steps? i couldnt do it with DataPipeline, Glue, DMS due to Certificate Issues at the Db.

  1. Scheduled Jobs that does S3 exports of initial/changed data. This is the least expensive as you can decide what tables to export data from and how often. You can decide to do that every 10 mins or so. AWS Batch can be used with Lambda to accomplish this. - any references to Achieve this?

Any other better optimised ways?

Thanks!!

Topics
DatabaseAnalytics
Tags
Aurora MySQLAmazon Redshift
Language
English
Bharani
asked 2 years ago469 views
1 Answer
3

The below link should be helpful for your use-case. The Incremental copy of Amazon RDS MySQL table to Amazon Redshift template copies data from an Amazon RDS MySQL table to an Amazon Redshift table by staging data in an Amazon S3 folder. This template copies changes that are made to the Amazon RDS MySQL table between scheduled intervals, starting from the scheduled start time. [https://docs.aws.amazon.com/datapipeline/latest/DeveloperGuide/dp-template-redshiftrdsincremental.html]

profile pictureAWS
EXPERT
Srikant Das
answered a year ago

You are not logged in. Log in to post an answer.

A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.

Guidelines for Answering Questions

Relevant content