How to remove delete-files of aws athena iceberg table

0

Aws athena iceberg table - i am using a merge into query, which is working as expected. But i noticed that the table referring to only 55 objects, whereas in s3 there around 250 objects. After exploring for some time, i understood that the other 200 files are delete-files. I am not storing any snapshots, so i dont require these s3 objects. Can someone help me understand how to delete those files?

JFYI… optimize and vacuum are clearing some unrequired data-files, but are not handling delete-files.

feita há um ano593 visualizações
1 Resposta
0

Is there any regularity in the names of files and folders placed in S3?
If the naming is such that it is regular, it may be better to use S3 lifecycle rules to delete the file.
https://docs.aws.amazon.com/AmazonS3/latest/userguide/how-to-set-lifecycle-configuration-intro.html

profile picture
ESPECIALISTA
respondido há um ano

Você não está conectado. Fazer login para postar uma resposta.

Uma boa resposta responde claramente à pergunta, dá feedback construtivo e incentiva o crescimento profissional de quem perguntou.

Diretrizes para responder a perguntas