how to autoscale MSK cluster horizontally in AWS

Question

I want to horizontally autoscale the AWS MSK cluster but only found documentation related to storage autoscaling. Is there any way to autoscale the AWS MSK cluster ? Any reference to docs or any articles will be appreciated.

Answer

MSK Provisioned doesn't provide auto-scaling capabilities. You can implement self-managed autoscaling using different metrics, Lambda function and trigger MSK APIs to add brokers per AZ, and rebalance partitions (with Cruise Control, for instance).

Alternatively, MSK Serverless does auto-scaling behind the scenes and doesn't require user to setup or configure anything.

how to autoscale MSK cluster horizontally in AWS

Contenido relevante