Does MSK cluster configuration update will affect existing topic configuration?

0

For example, if I change partion num in my cluster configuration and apply to the cluster, will it also help me update the existing topic partition number? If not, is there a list of configuration that will not be overriden by cluster configuration change after the resource has been initialized?

AWS
asked 2 years ago1001 views
1 Answer
1
Accepted Answer

Hi there, please find the answers inline

  1. For example, if I change partition num in my cluster configuration and apply to the cluster, will it also help me update the existing topic partition number?
  • Partition number (num.partitions), replication factor (default.replication.factor) etc which can be set in cluster level configuration only applies to the 'auto created topics'(auto.create.topics.enable=true).

  • And when you change this configuration it applies only to the auto created topics after the update was made, it doesn't update the existing topics configuration.

  1. If not, is there a list of configuration that will not be overridden by cluster configuration change after the resource has been initialized?
  • We do not currently have a list but parameters that can be applied on both topic level and cluster level are mostly only retention related parameters, segment related parameters and min.insync.replicas. The retention and segment related parameters set at topic level takes precedence over retention set at cluster level. Same applies to min.insync.replicas which by default is 2 at cluster level. But you can set it at topic level which takes precedence. So for above parameters topic level configurations takes precedence and cluster level settings won't override it.
AWS
SUPPORT ENGINEER
answered 2 years ago
AWS
EXPERT
reviewed 2 years ago

You are not logged in. Log in to post an answer.

A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.

Guidelines for Answering Questions