[DMS] Full Lob tasks lost connection

0

Hello, Im trying to migrate a large table with lobs. Scenário Master with Multi-AZ + RO Réplica Full Load + CDC

I set all timeout strings referenced in documentation. ignore foreign keys

DMs instance: dms.r5.xlarge

Errors:

  • DMS dont start populating new database
  • Mysql Connection Lost
  • Lost connection to MySQL server during query
  • Replication task has failed. Reason: Last Error Failed to connect to database. Stop Reason RECOVERABLE_ERROR Error Level RECOVERABLE.
  • [SOURCE_UNLOAD ]E: Connection error [1022506] (mysql_endpoint_imp.c:115)
  • Reloading table 21 because subtask #1 finished with error (replicationtask.c:2559)
  • Task error notification received from subtask 1, thread 0, status 1020414 (replicationtask.c:3400)

Target config: { "MaxFileSize": 1073741824, "ParallelLoadThreads": 1, "ExecuteTimeout": 3600 }

Master RDS I cant: Full load only Full load = CDC

RO Replica I can: Full load

Database description Size: 8GB Rows: 15995900

Ps: i migrated several databses without lobs with successful

질문됨 2달 전123회 조회
2개 답변
2
수락된 답변

Please try the following:

  • Set Timeout Strings: Ensure that all timeout settings referenced in the documentation are properly configured to accommodate the migration of large tables with LOBs. Pay particular attention to connection and execution timeouts.
  • Ignore Foreign Keys: Consider disabling foreign key constraints during the migration process to prevent potential issues related to referential integrity.
  • Optimize DMS Instance: Verify that the DMS instance (e.g., dms.r5.xlarge) has adequate resources to handle the migration workload. Consider scaling up the instance if necessary to improve performance.
  • Address Connection Issues: Investigate and address any MySQL connection issues, such as "Connection Lost" errors or "Lost connection to MySQL server during query" messages. This may involve optimizing network settings, adjusting connection parameters, or troubleshooting connectivity issues.
  • Check Replication Task Configuration: Review the replication task configuration, including parameters such as MaxFileSize and ParallelLoadThreads, to ensure they are appropriately set for the migration workload. Adjust these parameters as needed to optimize performance.
  • Troubleshoot Failed Tasks: Analyze error messages related to failed replication tasks, such as "Failed to connect to database" or "Connection error [1022506]." Look for patterns or common issues that may indicate the root cause of the problem.
  • Consider Full Load Only: If encountering persistent issues with CDC (Change Data Capture), consider using full load migration instead of CDC for the primary RDS instance. For read-only replica instances, full load migration may be sufficient.
  • Monitor Resource Usage: Continuously monitor resource usage on both the source and target databases during the migration process. Look for any signs of resource contention or bottlenecks that may impact performance.
  • Review Datbase Size and Structure: Validate the size and structure of the database, including the size of the table being migrated (e.g., 8GB with 15,995,900 rows). Ensure that the database schema is compatible with DMS migration.
profile picture
전문가
답변함 2달 전
profile picture
전문가
검토됨 2달 전
0

Thanks for the answer, I found a microservice that limits queries to 6m on Master Database.

답변함 2달 전

로그인하지 않았습니다. 로그인해야 답변을 게시할 수 있습니다.

좋은 답변은 질문에 명확하게 답하고 건설적인 피드백을 제공하며 질문자의 전문적인 성장을 장려합니다.

질문 답변하기에 대한 가이드라인