Trouble with enabling DMS S3 Target validation

0

Hello,

I’m trying to enable S3 target validation for a DMS task that does full-load and CDC, source is PostgreSQL and target is S3.

The first weird thing that I’ve noticed is that I can’t enable the validation through the UI, I can only do it through JSON (task settings). Even when it’s enabled it’s grayed out.

Enter image description here

So validation is enabled now and this is my config for it, it’s the default config:

"ValidationSettings": {
    "ValidationPartialLobSize": 0,
    "PartitionSize": 10000,
    "RecordFailureDelayLimitInMinutes": 0,
    "SkipLobColumns": false,
    "FailureMaxCount": 10000,
    "HandleCollationDiff": false,
    "ValidationQueryCdcDelaySeconds": 0,
    "ValidationMode": "ROW_LEVEL",
    "TableFailureMaxCount": 1000,
    "RecordFailureDelayInMinutes": 5,
    "MaxKeyColumnSize": 8096,
    "EnableValidation": true,
    "ThreadCount": 5,
    "RecordSuspendDelayInMinutes": 30,
    "ValidationOnly": false
  }

The validation status for that task, in table statistics, is “Records pending”, always.

Enter image description here

I checked the logs and there is one log that stands out to me:

[VALIDATOR_SOURC ]E:  AccessDenied: Access Denied [1001705]  (transfer_client.cpp:722)
[VALIDATOR_SOURC ]E:  failed to download file <landing/bonfirev3/aws_dms_validation_meta_data/aws_dms_validation_athena_results/6aca11c3-a306-4fda-8ba8-42025279b018.csv> from bucket <my-bucket> as </rdsdbdata/data/tasks/F3H5VF6X6N5ZZWWCO6T7XBN2OWYJZBTGAHZYCBY/athena_results/6aca11c3-a306-4fda-8ba8-42025279b018.csv>, status = 4 (FAILED) [1001705]  (transfer_client.cpp:725)
[VALIDATOR_TARGE ]I:  Failed to download file at s3://my-bucket/landing/test-database/aws_dms_validation_meta_data/aws_dms_validation_athena_results/6aca11c3-a306-4fda-8ba8-42025279b018.csv to local file location /rdsdbdata/data/tasks/F3H5VF6X6N5ZZWWCO6T7XBN2OWYJZBTGAHZYCBY/athena_results/6aca11c3-a306-4fda-8ba8-42025279b018.csv  (athena-utils.c:201)

So far I’ve checked the permissions of the role, they seem to be ok, tried re-creating and re-running the task a couple of times, and I couldn’t find anything online.

Any assistances is appreciated, thank you!

yatmee
已提问 7 个月前137 查看次数
没有答案

您未登录。 登录 发布回答。

一个好的回答可以清楚地解答问题和提供建设性反馈,并能促进提问者的职业发展。

回答问题的准则