[DMS] Full Lob tasks lost connection

0

Hello, Im trying to migrate a large table with lobs. Scenário Master with Multi-AZ + RO Réplica Full Load + CDC

I set all timeout strings referenced in documentation. ignore foreign keys

DMs instance: dms.r5.xlarge

Errors:

  • DMS dont start populating new database
  • Mysql Connection Lost
  • Lost connection to MySQL server during query
  • Replication task has failed. Reason: Last Error Failed to connect to database. Stop Reason RECOVERABLE_ERROR Error Level RECOVERABLE.
  • [SOURCE_UNLOAD ]E: Connection error [1022506] (mysql_endpoint_imp.c:115)
  • Reloading table 21 because subtask #1 finished with error (replicationtask.c:2559)
  • Task error notification received from subtask 1, thread 0, status 1020414 (replicationtask.c:3400)

Target config: { "MaxFileSize": 1073741824, "ParallelLoadThreads": 1, "ExecuteTimeout": 3600 }

Master RDS I cant: Full load only Full load = CDC

RO Replica I can: Full load

Database description Size: 8GB Rows: 15995900

Ps: i migrated several databses without lobs with successful

asked 7 months ago238 views
2 Answers
2
Accepted Answer

Please try the following:

  • Set Timeout Strings: Ensure that all timeout settings referenced in the documentation are properly configured to accommodate the migration of large tables with LOBs. Pay particular attention to connection and execution timeouts.
  • Ignore Foreign Keys: Consider disabling foreign key constraints during the migration process to prevent potential issues related to referential integrity.
  • Optimize DMS Instance: Verify that the DMS instance (e.g., dms.r5.xlarge) has adequate resources to handle the migration workload. Consider scaling up the instance if necessary to improve performance.
  • Address Connection Issues: Investigate and address any MySQL connection issues, such as "Connection Lost" errors or "Lost connection to MySQL server during query" messages. This may involve optimizing network settings, adjusting connection parameters, or troubleshooting connectivity issues.
  • Check Replication Task Configuration: Review the replication task configuration, including parameters such as MaxFileSize and ParallelLoadThreads, to ensure they are appropriately set for the migration workload. Adjust these parameters as needed to optimize performance.
  • Troubleshoot Failed Tasks: Analyze error messages related to failed replication tasks, such as "Failed to connect to database" or "Connection error [1022506]." Look for patterns or common issues that may indicate the root cause of the problem.
  • Consider Full Load Only: If encountering persistent issues with CDC (Change Data Capture), consider using full load migration instead of CDC for the primary RDS instance. For read-only replica instances, full load migration may be sufficient.
  • Monitor Resource Usage: Continuously monitor resource usage on both the source and target databases during the migration process. Look for any signs of resource contention or bottlenecks that may impact performance.
  • Review Datbase Size and Structure: Validate the size and structure of the database, including the size of the table being migrated (e.g., 8GB with 15,995,900 rows). Ensure that the database schema is compatible with DMS migration.
profile picture
EXPERT
answered 7 months ago
profile picture
EXPERT
reviewed 2 months ago
profile picture
EXPERT
reviewed 7 months ago
0

Thanks for the answer, I found a microservice that limits queries to 6m on Master Database.

answered 7 months ago

You are not logged in. Log in to post an answer.

A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.

Guidelines for Answering Questions