MSK - HELP Backup

0

Hi everyone, I need to create a backup for AWS MSK, and I found this article https://aws.amazon.com/en/blogs/big-data/back-up-and-restore-kafka-topic-data - using-amazon-msk-connect/ but the problem is that we have too many topics and new topics are created every day. How do I use this MSK backup solution in disaster recovery cases?

Luis
asked 2 years ago1506 views
1 Answer
0

Hello Luis,

I understand that you looking for Disaster Recovery solution for your AWS MSK topics. The blog you mentioned is currently the most effective method of backing up your MSK topic data.

To adjust the suggested method from the blog for a Disaster recovery solution, I recommend using MSK connect to backup data from your topics to a single S3 bucket. When it comes time to recover that data, Amazon Athena can be used to query said data to a new MSK cluster using MSK Connect.

You can move the MSK connector to the new cluster after recovery.

Resources: https://docs.aws.amazon.com/msk/latest/developerguide/mkc-S3sink-connector-example.html

https://docs.aws.amazon.com/athena/latest/ug/what-is.html

answered 2 years ago

You are not logged in. Log in to post an answer.

A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.

Guidelines for Answering Questions