[Kinesis Data Stream] [Enrichment] Question on Kinesis Data Stream Enrichment Solution

0

Hi Team,

Our Question:

Is there a feature that offered by Kinesis that allows us to enrich records in the same Kinesis stream? (get the plain record -> enrich it -> put it back into the same Kinesis, or enrich the records in place without take it out of the stream).

Background:

We are try to come up with a solution to enrich data in Kinesis Stream by join the incoming plain data with some static data. After research I see there are many ways to do so, such as use Flink, Lambda, or EventBridge Pipes.

However, Flink is not an option for us. We use Flink to do aggregation task already, we don't want to centralize all tasks in a same service, plus it may be costly and difficult to scale in our use case.

For Lambda and EventBridge, the problem is that we have to create a new Kinesis stream to deliver the enriched data to Flink.

Is there any way to enrich the records in place without create a new Kinesis stream?

已提問 5 個月前檢視次數 709 次
1 個回答
0

Hello ,

I understand you wish to get an approach to enrich data without creating a new kinesis stream . However unfortunately currently it is not possible to enrich the records in place without creating a new Kinesis stream .

AWS
已回答 5 個月前

您尚未登入。 登入 去張貼答案。

一個好的回答可以清楚地回答問題並提供建設性的意見回饋,同時有助於提問者的專業成長。

回答問題指南