DMS write to S3 files separated by date field from source

Question

Hello,
I'm trying to transfer data from SQL Server table to S3 parquet files.
I would like to write the data in S3 based on a date field which exists in the source.
For example:
Source table:
(id int,
name varchar(20)
dateCreated datetime)
I would like the load process to take the dateCreated field and to create separate files based on that value for each day.
load-21-12-2023.parquet
load-22-12-2023.parquet
load-23-12-2023.parquet
...
How can I tell the DMS endpoint to create the different files based on this field value?

Answer

there is not direct or simple way to do it. at the max you can apply source filter with specific date and resultant parquet files in different folders using separate task and target endpoints

DMS write to S3 files separated by date field from source

Relevant content