Maximum Migration BW

0

Hello, I’m trying to migrate 100 TB of data from AWS S3 in the US to Saudi Arabia on premise DC using AWS CLI.

What’s the best method/tool to do that? what’s the maximum Internet BW for data transfer as I’m getting 1 Gbps while my DC BW is 2 Gbps?

preguntada hace un año268 visualizaciones
1 Respuesta
0

Hi, I would try to reduce the number of hops for the last section of your transfer: between AWS cloud and your premises. So, I'd first copy from AWS US region to Middle East region (https://aws.amazon.com/local/middle_east/) and then copy from this region to your premise.

This way, the first copy will happen on AWS internal network at high speed. So, when data is close to your premises, you will probably get most of your existing bandwidth.

Note: this additional copy will cost you an additional 2 cts per GB (see https://aws.amazon.com/s3/pricing/) on top of the transfer of data from AWS network to Internet. So, up to you to decide if worth it or not depending on your cost constraint / budget.

The final copy to your premise can happen with AWS CLI: sync is what you probably want to use. See https://docs.aws.amazon.com/cli/latest/reference/s3/sync.html

It has a few parameters that you can use to optimize performances: max_concurrent_requests, max_bandwidth, etc. See https://awscli.amazonaws.com/v2/documentation/api/latest/topic/s3-config.html

profile pictureAWS
EXPERTO
respondido hace un año

No has iniciado sesión. Iniciar sesión para publicar una respuesta.

Una buena respuesta responde claramente a la pregunta, proporciona comentarios constructivos y fomenta el crecimiento profesional en la persona que hace la pregunta.

Pautas para responder preguntas