Usando AWS re:Post, accetti AWS re:Post Termini di utilizzo
AWS re:Postre:Post

MSK - HELP Backup

0

Hi everyone, I need to create a backup for AWS MSK, and I found this article https://aws.amazon.com/en/blogs/big-data/back-up-and-restore-kafka-topic-data - using-amazon-msk-connect/ but the problem is that we have too many topics and new topics are created every day. How do I use this MSK backup solution in disaster recovery cases?

Argomenti
ArchiviazioneAnalisi
Tag
Backup e ripristinoStreaming gestito da Amazon per Apache Kafka (Amazon MSK)
Lingua
English
Luis
posta 2 anni fa1597 visualizzazioni
1 Risposta
0

Hello Luis,

I understand that you looking for Disaster Recovery solution for your AWS MSK topics. The blog you mentioned is currently the most effective method of backing up your MSK topic data.

To adjust the suggested method from the blog for a Disaster recovery solution, I recommend using MSK connect to backup data from your topics to a single S3 bucket. When it comes time to recover that data, Amazon Athena can be used to query said data to a new MSK cluster using MSK Connect.

You can move the MSK connector to the new cluster after recovery.

Resources: https://docs.aws.amazon.com/msk/latest/developerguide/mkc-S3sink-connector-example.html

https://docs.aws.amazon.com/athena/latest/ug/what-is.html

Prithvidhar_P
con risposta 2 anni fa

Accesso non effettuato. Accedi per postare una risposta.

Una buona risposta soddisfa chiaramente la domanda, fornisce un feedback costruttivo e incoraggia la crescita professionale del richiedente.

Linee guida per rispondere alle domande

Contenuto pertinente