How to remove delete-files of aws athena iceberg table

Aws athena iceberg table - i am using a merge into query, which is working as expected. But i noticed that the table referring to only 55 objects, whereas in s3 there around 250 objects. After exploring for some time, i understood that the other 200 files are delete-files. I am not storing any snapshots, so i dont require these s3 objects. Can someone help me understand how to delete those files?

JFYI… optimize and vacuum are clearing some unrequired data-files, but are not handling delete-files.

주제

스토리지 분석

태그

아마존 심플 스토리지 서비스 아마존 Athena

언어

English

AWS-User-4333940

질문됨 일 년 전598회 조회

1개 답변

최신
최다 투표
가장 많은 댓글

이 답변이 도움이 되었나요?커뮤니티가 여러분의 지식을 활용할 수 있도록 정답을 찬성하세요.

Is there any regularity in the names of files and folders placed in S3?
If the naming is such that it is regular, it may be better to use S3 lifecycle rules to delete the file.
https://docs.aws.amazon.com/AmazonS3/latest/userguide/how-to-set-lifecycle-configuration-intro.html

전문가

Riku_Kobayashi

답변함 일 년 전

How to remove delete-files of aws athena iceberg table

관련 콘텐츠