Question on how KCL creates new RecordProcessors with multiple instances

0

Hi,

I am trying to understand how KCL manages total number of RecordProcessors when there are multiple instances of workers(or consumers).
So I did have a look at below link, and the example in the doc makes sense.
https://docs.aws.amazon.com/streams/latest/dev/kinesis-record-processor-scaling.html

But have a few follow up questions just to make sure if my understanding is correct.
In the example, it says # of "record processors" will automatically be updated per KCL worker.

And my question is:
So if I increased the same KCL worker (same application name and same kinesis configs), KCL will figure out how many workers (or instances) are out there based on the application name, and readjust # of record processors for each KCL worker accordingly.

Thanks in advance!

demandé il y a 4 ans418 vues
1 réponse
0

Yes, your understanding is correct.

AWS
répondu il y a 4 ans

Vous n'êtes pas connecté. Se connecter pour publier une réponse.

Une bonne réponse répond clairement à la question, contient des commentaires constructifs et encourage le développement professionnel de la personne qui pose la question.

Instructions pour répondre aux questions