Trouble with enabling DMS S3 Target validation

0

Hello,

I’m trying to enable S3 target validation for a DMS task that does full-load and CDC, source is PostgreSQL and target is S3.

The first weird thing that I’ve noticed is that I can’t enable the validation through the UI, I can only do it through JSON (task settings). Even when it’s enabled it’s grayed out.

Enter image description here

So validation is enabled now and this is my config for it, it’s the default config:

"ValidationSettings": {
    "ValidationPartialLobSize": 0,
    "PartitionSize": 10000,
    "RecordFailureDelayLimitInMinutes": 0,
    "SkipLobColumns": false,
    "FailureMaxCount": 10000,
    "HandleCollationDiff": false,
    "ValidationQueryCdcDelaySeconds": 0,
    "ValidationMode": "ROW_LEVEL",
    "TableFailureMaxCount": 1000,
    "RecordFailureDelayInMinutes": 5,
    "MaxKeyColumnSize": 8096,
    "EnableValidation": true,
    "ThreadCount": 5,
    "RecordSuspendDelayInMinutes": 30,
    "ValidationOnly": false
  }

The validation status for that task, in table statistics, is “Records pending”, always.

Enter image description here

I checked the logs and there is one log that stands out to me:

[VALIDATOR_SOURC ]E:  AccessDenied: Access Denied [1001705]  (transfer_client.cpp:722)
[VALIDATOR_SOURC ]E:  failed to download file <landing/bonfirev3/aws_dms_validation_meta_data/aws_dms_validation_athena_results/6aca11c3-a306-4fda-8ba8-42025279b018.csv> from bucket <my-bucket> as </rdsdbdata/data/tasks/F3H5VF6X6N5ZZWWCO6T7XBN2OWYJZBTGAHZYCBY/athena_results/6aca11c3-a306-4fda-8ba8-42025279b018.csv>, status = 4 (FAILED) [1001705]  (transfer_client.cpp:725)
[VALIDATOR_TARGE ]I:  Failed to download file at s3://my-bucket/landing/test-database/aws_dms_validation_meta_data/aws_dms_validation_athena_results/6aca11c3-a306-4fda-8ba8-42025279b018.csv to local file location /rdsdbdata/data/tasks/F3H5VF6X6N5ZZWWCO6T7XBN2OWYJZBTGAHZYCBY/athena_results/6aca11c3-a306-4fda-8ba8-42025279b018.csv  (athena-utils.c:201)

So far I’ve checked the permissions of the role, they seem to be ok, tried re-creating and re-running the task a couple of times, and I couldn’t find anything online.

Any assistances is appreciated, thank you!

Keine Antworten

Du bist nicht angemeldet. Anmelden um eine Antwort zu veröffentlichen.

Eine gute Antwort beantwortet die Frage klar, gibt konstruktives Feedback und fördert die berufliche Weiterentwicklung des Fragenstellers.

Richtlinien für die Beantwortung von Fragen