S3 Storage Class Migration

0

When I move my data which is in delta format from my S3 standard bucket to glacier through a lifecycle policy the delta logs are also getting inside the glacier which is causing the delta table to fail. Is there any way we can omit the delta logs files and move the rest data automatically through the lifecycle policy. N.B - we cannot use the prefix because the delta log and the data is present in the same folder.

已提问 1 年前260 查看次数
1 回答
0

Hi,

If you're unable to move the delta logs to a different prefix (folder), you could consider tagging your objects and then creating a lifecycle rule which limits the scope to the tags you define. That way you could exclude the delta logs by not tagging them, or tagging the differently.

Keep in mind that there are costs associated with applying tags to an object.

Fore more information on object tagging and lifecycle policies, take a look here:

https://docs.aws.amazon.com/AmazonS3/latest/userguide/object-tagging.html

https://docs.aws.amazon.com/AmazonS3/latest/userguide/intro-lifecycle-rules.html#intro-lifecycle-rules-filter

AWS
Tom-B
已回答 1 年前
  • how can we do that in AWS console...also how can we add tags to omit a specific sub folder under a folder which is going to get archived to AWS glacier

  • To tag objects in the console, you can select multiple objects then hit Actions > Edit Tags. You can't tag sub-folders, and you also can't exclude with lifecycle rules, you can however specify multiple rules which apply to different prefixes.

    This question and answer might help with the questions you're asking here: https://repost.aws/questions/QU7KUrJjJlT6apX8hejMDgfQ/s3-lifecycle-exclude-prefix

您未登录。 登录 发布回答。

一个好的回答可以清楚地解答问题和提供建设性反馈,并能促进提问者的职业发展。

回答问题的准则