1回答
- 新しい順
- 投票が多い順
- コメントが多い順
0
That's normal Iceberg behavior, it keeps the old files in case you want to get the data as it was in the past.
In the configuration you can tell it when to expire or you can force it, see:
https://iceberg.apache.org/docs/latest/maintenance/
https://iceberg.apache.org/docs/latest/configuration/
Thanks for your answer, Gonzalo!
My problem is, that i need to physically delete data older than 10 years due to legal regulations. The age is defined by the value of a certain column in my tables, because i processed a large chunk of old data at once so that the time of writing the data does not correspond to the real age of the data. Do you have a hint for me how to implement that? My impression is, that the snapshot expire mechanism work only for the physical age of objects on S3.