[Orphaned Kinesis Shards] Shards got stuck and are not processing any data

0

Yesterday we saw an event that couple of Shards in our Kinesis data streams were not processed at all.

Setup

We have a kinesis stream and we have a fargate service which is consuming the records from kinesis shards.

We have total 16 shards and 16 ECS tasks consuming from these shards.

What could be the possible root causes for stuck shards? What all things we should lookout for to debug this as we are seeing this issue continuously

1回答
0

There are a lot of causes leading to this

Look at this doc page that elaborates some: https://docs.aws.amazon.com/streams/latest/dev/troubleshooting-consumers.html

profile picture
エキスパート
回答済み 3ヶ月前

ログインしていません。 ログイン 回答を投稿する。

優れた回答とは、質問に明確に答え、建設的なフィードバックを提供し、質問者の専門分野におけるスキルの向上を促すものです。

質問に答えるためのガイドライン

関連するコンテンツ