1回答
- 新しい順
- 投票が多い順
- コメントが多い順
0
To add the table name, schema name and column details to the CSV files generated while replicating from RDS to S3, you can use the following approach:
- Configure the data replication job from RDS to S3 using AWS Database Migration Service.
- In the transformation settings of the job, map the table name, schema name and column names as new fields that will be added to each record in the CSV.
- For example, you can extract the table and schema details from the query used to fetch records from the RDS database. And column names can be hard coded.
- These new fields along with the actual data values will be written to each record in the generated CSV files during the replication process.
- The CSV files stored in S3 will now contain the additional context fields providing table, schema and column details for each record.
- This enriched format can be consumed downstream for loading back to another database while retaining the schema level context for each record.
関連するコンテンツ
- 質問済み 6年前
Hi Giovanni Lauria,
Thanks for the response. During Replication from RDS to S3 using DMS, if I am trying to add table name and schema name using add-column transformation rules, the table name and schema name are getting added at last like below
I,C901,2024-02-29 02:04:24,d94EE059335E5, TEMP_CONTENT,OWN Here TEMP_CONTENT is table name and OWN is schema name.
But as per rule when using S3 as source, The table name should be in 2nd index and schema name should be in 3rd index Expected: I,TEMP_CONTENT,OWN,C901,2024-02-29 02:04:24,d94EE059335E5