Kinesis Data Stream. Scaling and filtering

0

I have Kinesis Data Streams in one region and consumers in number of another regions. Consumers should receive messages regardless of whether they are delivered to other regions. Also consumers can be scaled in and out. Please advise how I can do the following

  1. Ensure that each consumer only read messages to which it's subscribed and doesn't read messages to which it shouldn't have access
  2. Scale Kinesis Data Stream based on consumer scaling. For example, consumer scaled-out by adding additional pod and then KDS adds more shards to the stream.
AWS
gefragt vor einem Jahr2197 Aufrufe
1 Antwort
0

In Kinesis data streams the access controls to stream is implemented using IAM policies , check out example here https://docs.aws.amazon.com/streams/latest/dev/controlling-access.html .

Regarding scaling, the recommended method is to use Kinesis Data Stream On-Demand Mode https://aws.amazon.com/blogs/aws/amazon-kinesis-data-streams-on-demand-stream-data-at-scale-without-managing-capacity/

AWS
beantwortet vor einem Jahr

Du bist nicht angemeldet. Anmelden um eine Antwort zu veröffentlichen.

Eine gute Antwort beantwortet die Frage klar, gibt konstruktives Feedback und fördert die berufliche Weiterentwicklung des Fragenstellers.

Richtlinien für die Beantwortung von Fragen