Maximum Migration BW

0

Hello, I’m trying to migrate 100 TB of data from AWS S3 in the US to Saudi Arabia on premise DC using AWS CLI.

What’s the best method/tool to do that? what’s the maximum Internet BW for data transfer as I’m getting 1 Gbps while my DC BW is 2 Gbps?

asked 10 months ago257 views
1 Answer
0

Hi, I would try to reduce the number of hops for the last section of your transfer: between AWS cloud and your premises. So, I'd first copy from AWS US region to Middle East region (https://aws.amazon.com/local/middle_east/) and then copy from this region to your premise.

This way, the first copy will happen on AWS internal network at high speed. So, when data is close to your premises, you will probably get most of your existing bandwidth.

Note: this additional copy will cost you an additional 2 cts per GB (see https://aws.amazon.com/s3/pricing/) on top of the transfer of data from AWS network to Internet. So, up to you to decide if worth it or not depending on your cost constraint / budget.

The final copy to your premise can happen with AWS CLI: sync is what you probably want to use. See https://docs.aws.amazon.com/cli/latest/reference/s3/sync.html

It has a few parameters that you can use to optimize performances: max_concurrent_requests, max_bandwidth, etc. See https://awscli.amazonaws.com/v2/documentation/api/latest/topic/s3-config.html

profile pictureAWS
EXPERT
answered 10 months ago

You are not logged in. Log in to post an answer.

A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.

Guidelines for Answering Questions