AWS Glue for SQL Server(on-premises) Data Migration

0

Curious to know about, can we use AWS Glue to migrate 24 TB data from MS SQL Server(On-prem) to S3?How much time will it take (average) and how much effective it would be from other options? And would it be costly from other options of data transfer(like AWS DataSync, Snowball)?

1개 답변
0

The choice of migration of data is often based on other requirements. Do you need to keep it in sync after initial migration? Or can you snapshot it, migrate the data, hydrate the SQL Server RDS instance, and then resume? Do you have a specific amount of time you want to accomplish this migration within?

Database migration service (DMS) can either transfer the data while the database is running, then provide that sync before switch over. It is more expensive than options like DataSync (or just S3 multi-part upload), which is mainly constrained by your bandwidth out of the source(s) and your company's internet connectivity. Sometimes, Snowball is the fastest way to get the data into S3 because of those bottlenecks. In some cases, I've seen those network bottlenecks impact DMS performance on highly mutating databases.

profile pictureAWS
답변함 2년 전
  • Actually the data migration is happening on Snowflake on Aws cloud, so the option of DMS is not valid here. Only doing the historical data migration, no sync up after that. And time limit is maximum 1 day.

  • The the time needed will be based on the internet capability of your uploading instance and your overall internet connectivity. Multi-part/multi-thread will help (DataSync does this as does the AWS CLI). You can then compare the estimated time to the time you think getting a Snowball device, getting it installed and sending it back will take.

로그인하지 않았습니다. 로그인해야 답변을 게시할 수 있습니다.

좋은 답변은 질문에 명확하게 답하고 건설적인 피드백을 제공하며 질문자의 전문적인 성장을 장려합니다.

질문 답변하기에 대한 가이드라인