Load S3 Bucket data into Aurora PostgreSQL tables

0

I need to load my data from S3 Bucket into the Aurora PostgreSQL tables. I read https://docs.aws.amazon.com/AmazonRDS/latest/AuroraUserGuide/USER_PostgreSQL.S3Import.html#USER_PostgreSQL.S3Import.Reference this documentation and I will try. But, do we have any other way to be able to handle this case?

Especially I want to ask, Is there any LOAD command which exists on Aurora PostgreSQL?

Thanks!

2개 답변
1

One option could be to use DMS.

DMS does support S3 as a source - https://docs.aws.amazon.com/dms/latest/userguide/CHAP_Source.S3.html

DMS supports Aurora Postgres as a target - https://docs.aws.amazon.com/dms/latest/userguide/CHAP_Target.PostgreSQL.html

profile pictureAWS
전문가
답변함 2년 전
  • I want to perform integrity check on my files in S3 bucket (The record count and md5 are 2 checks we need to do when files arrive in S3 from source DB). When these checks are successful, we want to load these files into Postgres. Can you please guide how this can be done? Integrity checks can be done in a bash script. Can we use the same script to copy files to Postgres?

0

The procedure for using the table_import_from_s3() function is explained here: https://docs.aws.amazon.com/AmazonRDS/latest/AuroraUserGuide/USER_PostgreSQL.S3Import.html

You call the function from a SELECT statement. And so you could automate that by calling psql from a shell script, and passing the SELECT statement as a -c (command) or -f (SQL script file) argument to psql.

AWS
답변함 일 년 전

로그인하지 않았습니다. 로그인해야 답변을 게시할 수 있습니다.

좋은 답변은 질문에 명확하게 답하고 건설적인 피드백을 제공하며 질문자의 전문적인 성장을 장려합니다.

질문 답변하기에 대한 가이드라인