Scheduler to fetch data from On-prem db

0

We have a requirement to sync the data from the on-prem database to AWS RDS (PotgreSQL) at specific intervals (unlike one-time data migration). Assume there is an Interconnect/VPN already established between AWS and On-prem network. The expected data volume is likely 1000 rows only, so I do not see the necessity to build ETL with AWS Glue. Given that, what are the possible solution options to fetch the data?
Can AWS Batch/a pg_cron job be considered here to execute a set of select and update SQLs? Alternatively, how do we trigger the AWS Lambda at certain intervals if AWS Lambda is a solution option for this requirement?

Appreciate your input.

1回答
0

Based on the volume, Lambda might be a very good option. The best way to invoke it on a schedule is to use EventBridge Scheduler.

profile pictureAWS
エキスパート
Uri
回答済み 1年前
  • Thanks Uri. But, though EventBridge is a serverless service, do you think an EventBridge event bus is required for this simple daily job scenario? Can't we manage an AWS Batch/a pg_cron job (within PostgreSQL db) to trigger a Lambda at a specific interval?

ログインしていません。 ログイン 回答を投稿する。

優れた回答とは、質問に明確に答え、建設的なフィードバックを提供し、質問者の専門分野におけるスキルの向上を促すものです。

質問に答えるためのガイドライン

関連するコンテンツ