Storing data coming via MQTT in a database to display it as a chart
Hi all, I'm collecting the data from sensors and sending them to AWS via MQTT. I can observe my data coming on MQTT test client in AWS IoT. Now, I would like to store the data in a database and later - to make a chart of it. I routed the data to DynamoDB, but I'm not certain about it, because the whole MQTT (JSON) message is stored in one column and I have no clue if it's even possible to make a chart out of it. Basically, my question is: am I on correct path? Is DynamoDB my friend in this case, or should I use other db/storage? Should I go and parse the MQTT/JSON message before storing? What tool should I use to build a basic chart out of my data?
Sorry for the amount of questions, but I'n very new to AWS and to clouds in general. Your help will be appreciated!
Thank you, Joanna
- Newest
- Most votes
- Most comments
Hi Kohrinn,
which database to use depends on your use-case. AWS provides a bunch of relational and NoSQL databases. If you want to use DynamoDB and store ever key in its own "column", please take a look at the DynamoDBv2 rules action. We do have also a blog about storing and visualizing IoT data with DynamoDB.
Cheers,
Philipp
Hi Kohrinn. I agree with Philipp's answer. I also recommend this blog for some good patterns: https://aws.amazon.com/blogs/iot/7-patterns-for-iot-data-ingestion-and-visualization-how-to-decide-what-works-best-for-your-use-case/. However, I would say there's more than just these 7 patterns.
Pattern 4 is perhaps one of the simplest patterns for producing visualizations of time series data. One of the simplest, not necessarily the best, or cheapest, or recommended for your use case. This short video may help you achieve that pattern: https://www.youtube.com/watch?v=z8T4hAERuOg .
Relevant content
- Accepted Answerasked 2 years ago
AWS OFFICIALUpdated 2 years ago- AWS OFFICIALUpdated 3 years ago
- AWS OFFICIALUpdated 2 months ago
- AWS OFFICIALUpdated 3 years ago
Yes, many more, including cheaper options like AWS IoT Basic Ingest. See this 2-minute video https://www.youtube.com/watch?v=BmJnWOY1I2Q&list=PLS47QG_BdOlSqynlBanGsmZAYWkm-6ELu&index=1 for it in action. Other videos in the same playlist show other options.