How to remove delete-files of aws athena iceberg table

0

Aws athena iceberg table - i am using a merge into query, which is working as expected. But i noticed that the table referring to only 55 objects, whereas in s3 there around 250 objects. After exploring for some time, i understood that the other 200 files are delete-files. I am not storing any snapshots, so i dont require these s3 objects. Can someone help me understand how to delete those files?

JFYI… optimize and vacuum are clearing some unrequired data-files, but are not handling delete-files.

asked 10 months ago551 views
1 Answer
0

Is there any regularity in the names of files and folders placed in S3?
If the naming is such that it is regular, it may be better to use S3 lifecycle rules to delete the file.
https://docs.aws.amazon.com/AmazonS3/latest/userguide/how-to-set-lifecycle-configuration-intro.html

profile picture
EXPERT
answered 10 months ago

You are not logged in. Log in to post an answer.

A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.

Guidelines for Answering Questions