How MSK connect choose in which subnet to run connector ?

Question

Lets say I have a kafka cluster having three brokers running in a different subnets. 
out of them only one is public and other two are private. public is attached to a NAT gateway, and private subnets traffic are routed via NAT.

so the question is when a connector is getting created we provide it with bootstrapServer address and subnets, how it decides in which subnet it should deploy the connector ? Thanks.

Answer

> so the question is when a connector is getting created we provide it with bootstrapServer address and subnets, how it decides in which subnet it should deploy the connector ?

Hello,

If you are creating the connector in AWS Console, you would need to select the MSK Cluster right. So, the Connector will automatically use the Network resources(VPC, Subnets, Security Groups) of the chosen MSK Cluster.

However, if you are creating the connector via the CLI/API, you would need to manually mention the Network resources(VPC, Subnets, Security Groups).

So, the Connector will be ideally deployed on all the subnets that are associated with your cluster which provides you the high availability.

How MSK connect choose in which subnet to run connector ?

Conteúdo relevante