- Le plus récent
- Le plus de votes
- La plupart des commentaires
When downloading large objects such as the following, it is recommended to split them into multiple requests and download them in parallel. Therefore, it is assumed that there is a certain speed limit (around 700 Mbps?).
As a general rule, when you download large objects within a Region from Amazon S3 to Amazon EC2, we suggest making concurrent requests for byte ranges of an object at the granularity of 8–16 MB. Make one concurrent request for each 85–90 MB/s of desired network throughput. To saturate a 10 Gb/s network interface card (NIC), you might use about 15 concurrent requests over separate connections. You can scale up the concurrent requests over more connections to saturate faster NICs, such as 25 Gb/s or 100 Gb/s NICs.
Hi,
You may want to consider S3 Transfer Acceleration: https://docs.aws.amazon.com/AmazonS3/latest/userguide/transfer-acceleration.html for such large files.
It is particularly helpful when you're geographically far away from the AWS region where your source S3 bucket is.
Best,
Didier
Contenus pertinents
- demandé il y a un an
- demandé il y a un an
- demandé il y a un an
- AWS OFFICIELA mis à jour il y a un an
- AWS OFFICIELA mis à jour il y a un an
- AWS OFFICIELA mis à jour il y a 2 ans