DMS task status not updated to failed.

0

Hello,

We are using AWS DMS and we run into an issue.

We are using DMS engine version 3.4.6 with Oracle 11.2.0.4 as source and PostgreSQL 13.3 destination.

At some point during the on-going replication the table public.awsdms_apply_exceptions is dropped.

Important precision: this table drop is was a mistake in our side.

This status is correctly reported in the task's logs at 2022-07-18T10:09:51 (see below). But the tasks status is not updated to failed or another status than Load complete, replication ongoing in the DMS web dashboard whereas the log reports:

2022-07-18T12:10:19.000+02:00	2022-07-18T10:10:19 [TASK_MANAGER ]I: Task - PX242JWPJG2JGAF43IIYQOJGLRH2JIPSGHIMGWQ is in STOPPED state, updating starting status to AR_NOT_APPLICABLE (repository.c:5102)

The tasks should be updated to failed.

Here is an extract of the end of the task log:

2022-07-18T12:09:51.000+02:00	2022-07-18T10:09:51 [SOURCE_CAPTURE ]I: Connecting to Oracle: Beginning session (oracle_endpoint_conn.c:944)
2022-07-18T12:09:51.000+02:00	2022-07-18T10:09:51 [SOURCE_CAPTURE ]I: Source endpoint 'Oracle' is using provider syntax 'Oracle' (provider_syntax_manager.c:623)
2022-07-18T12:09:51.000+02:00	2022-07-18T10:09:51 [TARGET_APPLY ]I: Target components st_0_DXUFS7VFZGTC74AD2ZB2RDWN4ARDGJBLR2263JY was reattached after 6 seconds. (subtask.c:1393)
2022-07-18T12:09:51.000+02:00	2022-07-18T10:09:51 [TASK_MANAGER ]I: Starting component st_0_DXUFS7VFZGTC74AD2ZB2RDWN4ARDGJBLR2263JY (subtask.c:1399)
2022-07-18T12:09:51.000+02:00	2022-07-18T10:09:51 [TARGET_APPLY ]I: Table 'public'.'awsdms_apply_exceptions' does not exist, insufficient privileges or no supported columns [1022517] (ar_odbc_conn.c:2177)
2022-07-18T12:09:51.000+02:00	2022-07-18T10:09:51 [TARGET_APPLY ]I: RetCode: SQL_ERROR SqlState: 42P01 NativeError: 1 Message: ERROR: relation "public.awsdms_apply_exceptions" does not exist; No query has been executed with that handle [1022502] (ar_odbc_conn.c:2277)
2022-07-18T12:09:51.000+02:00	2022-07-18T10:09:51 [TARGET_APPLY ]I: Failed to get table public.awsdms_apply_exceptions definition [1022500] (odbc_util.c:1189)
2022-07-18T12:09:51.000+02:00	2022-07-18T10:09:51 [METADATA_MANAGE ]I: Metadata Manager table definition cannot be found. Table ID: 491. Component ID: DXUFS7VFZGTC74AD2ZB2RDWN4ARDGJBLR2263JY [1022500] (metadatamanager.c:1545)
2022-07-18T12:09:51.000+02:00	2022-07-18T10:09:51 [TARGET_APPLY ]I: Failed to get table definition for exception table [1022500] (endpointshell.c:3454)
2022-07-18T12:09:51.000+02:00	2022-07-18T10:09:51 [TARGET_APPLY ]I: Error executing command [1022500] (streamcomponent.c:1979)
2022-07-18T12:09:51.000+02:00	2022-07-18T10:09:51 [TASK_MANAGER ]I: Stream component failed at subtask 0, component st_0_DXUFS7VFZGTC74AD2ZB2RDWN4ARDGJBLR2263JY [1022500] (subtask.c:1414)
2022-07-18T12:09:51.000+02:00	2022-07-18T10:09:51 [TARGET_APPLY ]I: Target component st_0_DXUFS7VFZGTC74AD2ZB2RDWN4ARDGJBLR2263JY was detached because of recoverable error. Will try to reattach (subtask.c:1537)
2022-07-18T12:09:51.000+02:00	2022-07-18T10:09:51 [SOURCE_CAPTURE ]I: Disconnecting Oracle database (oracle_endpoint_conn.c:1385)
2022-07-18T12:09:51.000+02:00	2022-07-18T10:09:51 [SOURCE_CAPTURE ]I: Disconnected Oracle database (oracle_endpoint_conn.c:1420)
2022-07-18T12:09:51.000+02:00	2022-07-18T10:09:51 [SORTER ]I: Final saved task state. Stream position 000000048BF51F4B02000001000124580003AFBC00100000000000048BF50F8F, Source id 12824386, next Target id 781961, confirmed Target id 0, last source timestamp 1658138988000000 (sorter.c:798)
2022-07-18T12:10:19.000+02:00	2022-07-18T10:10:19 [SOURCE_CAPTURE ]I: Disconnecting Oracle database (oracle_endpoint_conn.c:1385)
2022-07-18T12:10:19.000+02:00	2022-07-18T10:10:19 [SOURCE_CAPTURE ]I: Disconnected Oracle database (oracle_endpoint_conn.c:1420)
2022-07-18T12:10:19.000+02:00	2022-07-18T10:10:19 [TASK_MANAGER ]I: Subtask #0 ended (replicationtask_util.c:589)
2022-07-18T12:10:19.000+02:00	2022-07-18T10:10:19 [TASK_MANAGER ]I: Task - PX242JWPJG2JGAF43IIYQOJGLRH2JIPSGHIMGWQ is in STOPPED state, updating starting status to AR_NOT_APPLICABLE (repository.c:5102)
2022-07-18T12:10:19.000+02:00	2022-07-18T10:10:19 [TASK_MANAGER ]I: Updated Task, PX242JWPJG2JGAF43IIYQOJGLRH2JIPSGHIMGWQ, info with TaskState - 0 (replicationtask.c:3933)
2022-07-18T12:10:19.000+02:00	2022-07-18T10:10:19 [TASK_MANAGER ]I: Task management thread terminated (replicationtask.c:3956)
2022-07-18T12:10:19.000+02:00	2022-07-18T10:10:19 [METADATA_MANAGE ]I: Disconnecting Oracle database (oracle_endpoint_conn.c:1385)
2022-07-18T12:10:19.000+02:00	2022-07-18T10:10:19 [METADATA_MANAGE ]I: Disconnected Oracle database (oracle_endpoint_conn.c:1420)
2022-07-18T12:10:19.000+02:00	2022-07-18T10:10:19 [AT_GLOBAL ]I: Closing log file at Mon Jul 18 10:10:19 2022 (at_logger.c:2766)
1 Answer
0

The awsdms_apply_exceptions table is used by DMS to record exceptions and that table appears to be missing. Depending upon settings the DMS task may stop in failed state or continue replication. Please open a support case with AWS support for your specific use case.

AWS
SV
answered 2 years ago

You are not logged in. Log in to post an answer.

A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.

Guidelines for Answering Questions