Browse through the questions and answers listed below or filter and sort to narrow down your results.
1
answers
0
votes
13
views
asked 15 days ago
1
answers
0
votes
18
views
asked 2 years ago
How does DataSync determine if a file has changed?
Example use case is a daily data export locally that needs to sync to S3. There is no way to check what has changed before exporting, so must export the full dataset. Aim is to only upload what has changed to S3. DataSync seems like it will work (it will only be one-way transfer daily so choosing DataSync over Transfer or File Gateway) but how does it determine what has changed?
I found the [docs][1] which say:
> In the PREPARING status, DataSync examines the source and destination file systems to determine which files to sync. It does so by recursively scanning the contents of the source and destination file systems for differences.
Will this scan the contents of the files themselves, or just the filesystem metadata? Anyone know anymore details on how it determines what has changed?
[1]: https://docs.aws.amazon.com/datasync/latest/userguide/how-datasync-works.html#transfering-files
Accepted AnswerAWS DataSync
1
answers
0
votes
22
views
asked 2 years ago
DataSync Agent -- What user does it run as?
A customer is running a POC of DataSync to sync files from an Isilon file system to S3. They have strict audit logging requirements and would like to configure the DataSync agent to access the file system via NFS using a specific user in order to track its access in their audit logs.
What user does the DataSync Agent run as?
Can it be configured to run as a different user or to access the NFS mount as a specific user?
Accepted AnswerAWS DataSync
1
answers
0
votes
17
views
asked 2 years ago
How do DataSync incremental transfers work?
A customer is planning to use DataSync to copy data to EFS and a question came up about incremental transfers:
If a single byte is changed on a source file after an initial transfer, does DataSync transfer the entire file or just the changed bytes during a subsequent transfer? The [documentation][1] states only files that have been added, modified, or deleted are transferred. This suggests to me that an incremental transfer copies an entire file if it has changed, not just a delta of changed bytes. Is that the case or does it work like rsync and transfers only the changed bytes?
[1]: https://docs.aws.amazon.com/datasync/latest/userguide/how-datasync-works.html
Accepted AnswerAWS DataSync
1
answers
0
votes
29
views
asked 2 years ago
AWS DataSync - Control Traffic Details
A customer is working to enable AWS DataSync to be consumed. A question from the Security Architect is what does the control traffic on 1024-1064 include? Is this traffic encrypted ?
I do understand this is a communication requirement between the DataSync Agent EC2/VM and DataSync Service per https://docs.aws.amazon.com/datasync/latest/userguide/datasync-network.html
Thanks
Accepted AnswerAWS DataSync
1
answers
0
votes
15
views
asked 2 years ago
Datasync Agent in VPC
A customer is interested in DataSync and their security department is telling them to use VPC Endpoints/PrivateLink. As the team is looking through the documentation to provide the security department, a point of clarification is needed (https://docs.aws.amazon.com/datasync/latest/userguide/datasync-in-vpc.html).
Documentation states that the agent can be "either on-premises or in-cloud and the DataSync service doesn't need to travel across the public internet or need public IP addresses". The following paragraph goes on to describe considerations when deploying the agent in a VPC. The customer would prefer to deploy the VMWare Datasync agent on-premises.
East question that I would like answered: Does the agent have to be deployed in a VPC to use VPCE?
Thank you in advance.
Accepted AnswerAWS DataSync
1
answers
0
votes
10
views
asked 3 years ago
DataSync Validate Existing Data in S3 then Copy Changes
A customer manually copied over data via Snowball to S3 from an on-prem NFS mount. They are looking to copy changes since that transfer as well as verify all the files that are already in S3. Can DataSync compare hashes for existing files in S3 and then copy changes?
Accepted AnswerAWS DataSync
1
answers
0
votes
13
views
asked 3 years ago
1
answers
0
votes
1
views
asked 3 years ago
3
answers
0
votes
5
views
asked 3 years ago