1 Answer
- Newest
- Most votes
- Most comments
0
Hi, 2'000'000s at 1 GBps to migrate your volume give you the opportunity to execute 2M x 3'500 req/s = 7B requests per type of requests (PUT, COPY, etc.) over the total duration. Given the fact that you have 50M objects, it gives you the opportunity to execute 100+ requests of each type during the transfer. It should not be the bottleneck.
The "at 1 Gbps" means that you can configure you replication setup to sustain this throughput during the whole transfer.
A key aspect will be to optimize properly the S3 cp or perf params: see https://docs.aws.amazon.com/cli/latest/topic/s3-config.html for all the options that you have in defining your optimal parallelism
Hope it helps!
Didier
Relevant content
- Accepted Answerasked a year ago
- Accepted Answerasked a year ago
- AWS OFFICIALUpdated a year ago
- AWS OFFICIALUpdated 2 years ago
- AWS OFFICIALUpdated 2 years ago
- AWS OFFICIALUpdated 10 months ago
It is not possible to use cli due to some client requirements. The current possible option is using AWS console. Is there a way to do it through console?