Maximum Migration BW

0

Hello, I’m trying to migrate 100 TB of data from AWS S3 in the US to Saudi Arabia on premise DC using AWS CLI.

What’s the best method/tool to do that? what’s the maximum Internet BW for data transfer as I’m getting 1 Gbps while my DC BW is 2 Gbps?

gefragt vor einem Jahr268 Aufrufe
1 Antwort
0

Hi, I would try to reduce the number of hops for the last section of your transfer: between AWS cloud and your premises. So, I'd first copy from AWS US region to Middle East region (https://aws.amazon.com/local/middle_east/) and then copy from this region to your premise.

This way, the first copy will happen on AWS internal network at high speed. So, when data is close to your premises, you will probably get most of your existing bandwidth.

Note: this additional copy will cost you an additional 2 cts per GB (see https://aws.amazon.com/s3/pricing/) on top of the transfer of data from AWS network to Internet. So, up to you to decide if worth it or not depending on your cost constraint / budget.

The final copy to your premise can happen with AWS CLI: sync is what you probably want to use. See https://docs.aws.amazon.com/cli/latest/reference/s3/sync.html

It has a few parameters that you can use to optimize performances: max_concurrent_requests, max_bandwidth, etc. See https://awscli.amazonaws.com/v2/documentation/api/latest/topic/s3-config.html

profile pictureAWS
EXPERTE
beantwortet vor einem Jahr

Du bist nicht angemeldet. Anmelden um eine Antwort zu veröffentlichen.

Eine gute Antwort beantwortet die Frage klar, gibt konstruktives Feedback und fördert die berufliche Weiterentwicklung des Fragenstellers.

Richtlinien für die Beantwortung von Fragen