- Newest
- Most votes
- Most comments
If you're experiencing issues with Kafka retention not deleting all data as expected, there are a few things you can check to ensure there are no loose ends:
-
You may verify that the server/cluster level retention policy parameters are same as topic level configuration because if a topic is created with a different retention setting than the one you intend to use, Kafka will retain data based on the topic's retention policy instead of the server/cluster configuration.
-
Also make sure that the 'log.cleanup.policy' configuration is set to 'delete' (the default) rather than 'compact'. The 'compact' policy retains the latest value for each key and may interfere with data deletion.
If the above suggestions doesn't help you, in that case you may reach to Support team via support case with more details such as current configuration, cluster ARN, which topic's documents are not getting deleted etc. and they will be happy to guide you further.
Relevant content
- Accepted Answerasked a year ago
- AWS OFFICIALUpdated a year ago
- AWS OFFICIALUpdated 2 years ago
- AWS OFFICIALUpdated 23 days ago
- AWS OFFICIALUpdated 2 years ago