Data Migration from One account s3 to another account s3 using data sync

0

At the moment, we are trying to transfer 200 TB of data from one S3 account to another S3 account using Data Sync. I would like to know what bandwidth the data will migrate into, if it is dependent on our network bandwidth, or if it will be taken by AWS. And I also want to know what the different types of costs are for all of that migration.

2개 답변
3
수락된 답변

Hi Raj

Moving data from one s3 bucket to another, your network bandwidth won't come into the play. Refer this Datasync Network Requirement.

However if you are migrating data from on prem to AWS, then you can control the bandwidth limit. Reference document link is here Datasync Limiting Bandwidth.

For pricing, datasync has fairly simple pricing and refer example3 here at this documentation Datasync Pricing . Though there are few other factors involved, but major one to keep in mind while using datasync is source and target region when both are AWS.

I'm pasting the verbiage for your quick reference from above mentioned link:

Copying data to and from Amazon S3

When copying data to or from S3, you are charged standard request charges for the following S3 requests: LIST, HEAD, GET, PUT, and COPY. The exact operations performed depend upon the configuration of your DataSync task. For more information, read about evaluating S3 request costs in our documentation. Requests and storage charges can vary between S3 storage classes. You may also incur additional charges when reading and writing objects in different S3 storage classes. Read about working with Amazon S3 storage classes in our documentation.

Additional References: Configuring AWS DataSync transfers with Amazon S3

Tutorial: Transferring data from Amazon S3 to Amazon S3 in a different AWS account

https://aws.amazon.com/datasync/faqs/#:~:text=You%20can%20use%20VPC%20endpoints,or%20need%20public%20IP%20addresses.

AWS DataSync FAQs

Protect your files using AWS DataSync

PS: S3 batch replication is something too, which can be considered for large volume of data transfers between two s3 buckets. S3 Batch Replication

If this answers your question, please accept the answer. Thank you!

profile pictureAWS
전문가
답변함 일 년 전
profile picture
전문가
검토됨 일 년 전
  • One more doubt, How we can securely do the migration process over the internet. Normally the data will travel through the internet when we using data sync.Can you give some advice how to secure the data while migration.

  • Thank you so much Abhishek.

  • It seems my update to answer with artifacts wasn't posted. These additional references would definitely help in getting more familiar with datasync.

  • Absolutely, all the data including metadata would be encrypted in transit using TLS1.2. AWS datasync is an online service, where you can copy data over internet, or within VPC via direct connect or VPN. For your clarity, I've added few artifacts at the end of the answer, which would definitely help you in getting more clarity about data security, cost, movement, datasync setup. Please take a look and let me know if you have any additional questions.

0

I would like to know how much time will took for migrating 200 TB data and 50 million objects from one s3 to another account s3 using data sync and also want to know the cost for it.

답변함 10달 전
  • I have transferred ~500TB of data in roughly approx 14-15hours, but in my case, number of files were not much since each file size was in GBs.

로그인하지 않았습니다. 로그인해야 답변을 게시할 수 있습니다.

좋은 답변은 질문에 명확하게 답하고 건설적인 피드백을 제공하며 질문자의 전문적인 성장을 장려합니다.

질문 답변하기에 대한 가이드라인