By using AWS re:Post, you agree to the AWS re:Post Terms of Use

Kinesis Data Analytics record ordering

0

if I push IoT Core data to Kinesis Analytics as stream, how possible is to apply order by query to streaming data because you don't have complete data to call "order by" ? My goal is pushing IoT Core data and push them to Analytics in order to put them in sequence and push to AppSync to broadcast to subscribers. This Way I can visualize the data flow in time series and sequential in real time. Thanks

2 Answers
0

AWS IoT does not guarantee the order of received messages :

The message broker doesn't guarantee the order in which messages and ACK are received.

Therefore, to use the order by clause in Amazon Kinesis Analytics, you need to have an attribute in the MQTT payload that you can order on. Ideally it's your device that adds it e.g a sequence number or timestamp.

profile pictureAWS
EXPERT
answered 2 years ago
0

Definitely I will have attribute for order by, but my point if you don't have all of the record order by will miss some of them, unless you wait all messages received and run order by

answered 2 years ago

You are not logged in. Log in to post an answer.

A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.

Guidelines for Answering Questions