Delete S3 bucket data after 30 days

0

Hello everyone, I'm still fairly new to AWS and am just getting used to it. I back up data via Veeam to an S3 bucket every day. This works quite well, but the memory becomes more and more full and the costs rise. In Veeam I have set the backups to be kept for a maximum of 14 days, but this doesn't seem to work for the S3 bucket. I tried setting up a deletion routine but it doesn't seem to work. I would be happy if someone here would support me with a how-to-do on how I can reduce the amount of data, as I won't be able to get any information with the help. Thanks in advance for your support

LG Chris

asked 4 months ago1045 views
5 Answers
2

Hello.

Veeam doesn’t support S3 Lifecycle policies on any S3 buckets that are used as Veeam object storage repositories. These include polices with Amazon S3 storage class transitions and S3 Lifecycle expiration rules. Veeam must be the sole entity that manages these objects. Enabling S3 Lifecycle policies might have unexpected results, including data loss. [Reference] https://docs.aws.amazon.com/prescriptive-guidance/latest/patterns/back-up-and-archive-data-to-amazon-s3-with-veeam-backup-replication.html

You should be able to configure the backup retention for from Veeam Console only, you can also have a look at the S3 bucket as Veeam should create folders within S3 Bucket for each day, so you can identify the number of backup copies kept in S3 Bucket.

you can also refer to below link to have more information on capacity tier and data retention:

https://helpcenter.veeam.com/archive/backup/110/vsphere/capacity_tier_move.html & https://helpcenter.veeam.com/archive/backup/110/vsphere/capacity_tier_retention.html

Hope this helps.

AWS
answered 4 months ago
0

Hello.

I think it is better to use lifecycle rules to delete data in S3.
By using this setting, it is possible to save objects for a specified number of days after they are uploaded to S3 and then delete them.
https://docs.aws.amazon.com/AmazonS3/latest/userguide/how-to-set-lifecycle-configuration-intro.html

In your case, you want to save for 14 days, so if you check "Expire current versions of objects" in the lifecycle rule and set the number of days to 14, it will be deleted after 14 days.
If you have versioning configured in S3, you will also need to create a lifecycle rule to delete old versions.

profile picture
EXPERT
answered 4 months ago
profile picture
EXPERT
reviewed 4 months ago
profile picture
EXPERT
reviewed 4 months ago
0

|Hello Riku, thank you for your quick answer. I have set up a life cycle in the top folder under Administration. I have activated the following as lifecycle rules. "Permanently delete current object versions of objects" and "Delete non-current versions of objects" Under Expire current object versions I entered 14. I also entered 14 days under Permanently delete non-current versions of objects.

I hope I did everything right and it works.

Thanks for the support

answered 4 months ago
0
profile picture
EXPERT
answered 4 months ago
0

As @Sheelnidhi mentioned, do NOT turn on lifecycle policies with Veeam. Keep in mind that your oldest objects will be older than the 14 days you've specified as your retention period. This is because Veeam retains objects if they are still referred to in an existing backup. However, your consumption will eventually "flatten" with Veeam, as it deletes objects from old backups.

profile pictureAWS
EXPERT
wjquigs
answered 4 months ago

You are not logged in. Log in to post an answer.

A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.

Guidelines for Answering Questions