S3 Storage Class Migration

0

When I move my data which is in delta format from my S3 standard bucket to glacier through a lifecycle policy the delta logs are also getting inside the glacier which is causing the delta table to fail. Is there any way we can omit the delta logs files and move the rest data automatically through the lifecycle policy. N.B - we cannot use the prefix because the delta log and the data is present in the same folder.

1개 답변
0

Hi,

If you're unable to move the delta logs to a different prefix (folder), you could consider tagging your objects and then creating a lifecycle rule which limits the scope to the tags you define. That way you could exclude the delta logs by not tagging them, or tagging the differently.

Keep in mind that there are costs associated with applying tags to an object.

Fore more information on object tagging and lifecycle policies, take a look here:

https://docs.aws.amazon.com/AmazonS3/latest/userguide/object-tagging.html

https://docs.aws.amazon.com/AmazonS3/latest/userguide/intro-lifecycle-rules.html#intro-lifecycle-rules-filter

AWS
Tom-B
답변함 일 년 전
  • how can we do that in AWS console...also how can we add tags to omit a specific sub folder under a folder which is going to get archived to AWS glacier

  • To tag objects in the console, you can select multiple objects then hit Actions > Edit Tags. You can't tag sub-folders, and you also can't exclude with lifecycle rules, you can however specify multiple rules which apply to different prefixes.

    This question and answer might help with the questions you're asking here: https://repost.aws/questions/QU7KUrJjJlT6apX8hejMDgfQ/s3-lifecycle-exclude-prefix

로그인하지 않았습니다. 로그인해야 답변을 게시할 수 있습니다.

좋은 답변은 질문에 명확하게 답하고 건설적인 피드백을 제공하며 질문자의 전문적인 성장을 장려합니다.

질문 답변하기에 대한 가이드라인

관련 콘텐츠