How to remove delete-files of aws athena iceberg table

0

Aws athena iceberg table - i am using a merge into query, which is working as expected. But i noticed that the table referring to only 55 objects, whereas in s3 there around 250 objects. After exploring for some time, i understood that the other 200 files are delete-files. I am not storing any snapshots, so i dont require these s3 objects. Can someone help me understand how to delete those files?

JFYI… optimize and vacuum are clearing some unrequired data-files, but are not handling delete-files.

gefragt vor einem Jahr598 Aufrufe
1 Antwort
0

Is there any regularity in the names of files and folders placed in S3?
If the naming is such that it is regular, it may be better to use S3 lifecycle rules to delete the file.
https://docs.aws.amazon.com/AmazonS3/latest/userguide/how-to-set-lifecycle-configuration-intro.html

profile picture
EXPERTE
beantwortet vor einem Jahr

Du bist nicht angemeldet. Anmelden um eine Antwort zu veröffentlichen.

Eine gute Antwort beantwortet die Frage klar, gibt konstruktives Feedback und fördert die berufliche Weiterentwicklung des Fragenstellers.

Richtlinien für die Beantwortung von Fragen