Can you combine S3 Transfer Acceleration with Horizontal Scaling & Request Parallelization?

Question

Can you combine [S3 Transfer Acceleration](https://docs.aws.amazon.com/whitepapers/latest/s3-optimizing-performance-best-practices/using-amazon-s3-transfer-acceleration-to-accelerate-geographically-disparate-data-transfers.html) with [Horizontal Scaling & Request Parallelization](https://docs.aws.amazon.com/whitepapers/latest/s3-optimizing-performance-best-practices/horizontal-scaling-and-request-parallelization-for-high-throughput.html)? I assume you'd just need to enable Transfer Acceleration on the destination bucket and then use the Acceleration endpoint when setting up a parallelization mechanism like [TransferManager](https://docs.aws.amazon.com/sdk-for-java/v1/developer-guide/examples-s3-transfermanager.html)?

Answer

Hello!

Yes, you can use both S3 Transfer Acceleration and S3 Horizontal Scaling & Request Parallelization together, as you stated. You would use the acceleration endpoint where needed, though this may mean changes to your workflow or code in order to use the endpoint. See this for examples on how to use Transfer Acceleration: https://docs.aws.amazon.com/AmazonS3/latest/userguide/transfer-acceleration-examples.html. However, once you have refactored around this, you should be able to use parallelism with Transfer Acceleration.
     
Hope this helps!

Can you combine S3 Transfer Acceleration with Horizontal Scaling & Request Parallelization?

Relevant content