Scheduler to fetch data from On-prem db

0

We have a requirement to sync the data from the on-prem database to AWS RDS (PotgreSQL) at specific intervals (unlike one-time data migration). Assume there is an Interconnect/VPN already established between AWS and On-prem network. The expected data volume is likely 1000 rows only, so I do not see the necessity to build ETL with AWS Glue. Given that, what are the possible solution options to fetch the data?
Can AWS Batch/a pg_cron job be considered here to execute a set of select and update SQLs? Alternatively, how do we trigger the AWS Lambda at certain intervals if AWS Lambda is a solution option for this requirement?

Appreciate your input.

1 個回答
0

Based on the volume, Lambda might be a very good option. The best way to invoke it on a schedule is to use EventBridge Scheduler.

profile pictureAWS
專家
Uri
已回答 1 年前
  • Thanks Uri. But, though EventBridge is a serverless service, do you think an EventBridge event bus is required for this simple daily job scenario? Can't we manage an AWS Batch/a pg_cron job (within PostgreSQL db) to trigger a Lambda at a specific interval?

您尚未登入。 登入 去張貼答案。

一個好的回答可以清楚地回答問題並提供建設性的意見回饋,同時有助於提問者的專業成長。

回答問題指南