How can multiple files in my S3 Bucket be dowloaded as a batch vs one at a time?

0

I am trying to download data for a movie and there are multiple files in my S3 bucket. Is there a way to download them as a batch versus one at a time? This process is time-consuming.

질문됨 10달 전734회 조회
1개 답변
0

Since S3 doesn't support wild card characters so there is no direct way of doing that. If you can have files in a single folder within s3 then you can download all files at once by downloading that entire folder through CLI as s3 console won't let you download folder as well.

Here is how you'd download all files within a folder, in this example I'm downloading all files with .gzip extension:

aws s3 cp s3://<bkt_name>/<folder_name>/ ./ --profile <cli_profile_name> --recursive --exclude "*" --include "*.gzip*

See AWS S3 CLI for various exclude-include options along with s3 cp command synopsis.

This may not be the exact thing, that you'd be expecting but this is the way with which you can download multiple files.

Hope you find this usful.

Abhishek

profile pictureAWS
전문가
답변함 10달 전
  • Do you have any additional questions, happy to help.

로그인하지 않았습니다. 로그인해야 답변을 게시할 수 있습니다.

좋은 답변은 질문에 명확하게 답하고 건설적인 피드백을 제공하며 질문자의 전문적인 성장을 장려합니다.

질문 답변하기에 대한 가이드라인

관련 콘텐츠