Maximum Migration BW

0

Hello, I’m trying to migrate 100 TB of data from AWS S3 in the US to Saudi Arabia on premise DC using AWS CLI.

What’s the best method/tool to do that? what’s the maximum Internet BW for data transfer as I’m getting 1 Gbps while my DC BW is 2 Gbps?

已提问 1 年前268 查看次数
1 回答
0

Hi, I would try to reduce the number of hops for the last section of your transfer: between AWS cloud and your premises. So, I'd first copy from AWS US region to Middle East region (https://aws.amazon.com/local/middle_east/) and then copy from this region to your premise.

This way, the first copy will happen on AWS internal network at high speed. So, when data is close to your premises, you will probably get most of your existing bandwidth.

Note: this additional copy will cost you an additional 2 cts per GB (see https://aws.amazon.com/s3/pricing/) on top of the transfer of data from AWS network to Internet. So, up to you to decide if worth it or not depending on your cost constraint / budget.

The final copy to your premise can happen with AWS CLI: sync is what you probably want to use. See https://docs.aws.amazon.com/cli/latest/reference/s3/sync.html

It has a few parameters that you can use to optimize performances: max_concurrent_requests, max_bandwidth, etc. See https://awscli.amazonaws.com/v2/documentation/api/latest/topic/s3-config.html

profile pictureAWS
专家
已回答 1 年前

您未登录。 登录 发布回答。

一个好的回答可以清楚地解答问题和提供建设性反馈,并能促进提问者的职业发展。

回答问题的准则

相关内容