Upload folders in s3

Question

i am trying to upload a folder in a s3 bucker my folder has sub folders and those subfolders have some files and sub folders too now what is happening is that when i try to upload the main folder it has 5 sub folders in it top 4 are ignored and the 5th is just uploaded rest are not being uploaded can you help me out with this issue

Gary Mclean EXPERT
5 months ago
how are you trying to upload them? CLi, Console. 3rd Party app?

Didier_Durand · Answer

Hi,

The most efficient way to do that at scale is via CLI (much faster than console for large folders). I personally use `aws s3 sync  s3:///`

See for all options:  https://docs.aws.amazon.com/cli/latest/reference/s3/sync.html

Best

Didier

Paul-B-AWS · Answer

Hi.

If you are working with .NET projects using the AWS SDK for .NET, see an example of recursive file and folder uploads using the  [S3 Transfer Utility](https://docs.aws.amazon.com/sdkfornet/v3/apidocs/items/S3/TTransferUtility.html),  at https://docs.aws.amazon.com/AmazonS3/latest/userguide/HLuploadDirDotNet.html

Additional examples of the Transfer Utility:
* https://docs.aws.amazon.com/AmazonS3/latest/dev/usingHLmpuDotNet.html (high level API)
* https://github.com/awsdocs/aws-doc-sdk-examples/tree/main/dotnetv3/S3/scenarios/TransferUtilityBasics/TransferUtilityBasics
* https://docs.aws.amazon.com/AmazonS3/latest/userguide/mpuoverview.html (various sub-topics)

Upload folders in s3

Relevant content