How to remove delete-files of aws athena iceberg table

0

Aws athena iceberg table - i am using a merge into query, which is working as expected. But i noticed that the table referring to only 55 objects, whereas in s3 there around 250 objects. After exploring for some time, i understood that the other 200 files are delete-files. I am not storing any snapshots, so i dont require these s3 objects. Can someone help me understand how to delete those files?

JFYI… optimize and vacuum are clearing some unrequired data-files, but are not handling delete-files.

preguntada hace un año593 visualizaciones
1 Respuesta
0

Is there any regularity in the names of files and folders placed in S3?
If the naming is such that it is regular, it may be better to use S3 lifecycle rules to delete the file.
https://docs.aws.amazon.com/AmazonS3/latest/userguide/how-to-set-lifecycle-configuration-intro.html

profile picture
EXPERTO
respondido hace un año

No has iniciado sesión. Iniciar sesión para publicar una respuesta.

Una buena respuesta responde claramente a la pregunta, proporciona comentarios constructivos y fomenta el crecimiento profesional en la persona que hace la pregunta.

Pautas para responder preguntas