- Mais recentes
- Mais votos
- Mais comentários
Amazon Kinesis Data Firehose is a good fit to ingest data and process them as batches, enrich and store them on Amazon S3.
You can use Amazon Kinesis Data Streams to feed data to Firehose. For your device data ingestion simulation use case; you can use AWS SDK in your preferred programming language to call Kinesis Streams PutRecord API ( https://docs.aws.amazon.com/kinesis/latest/APIReference/API_PutRecord.html ) on your simulation data creator script. Thus, your data will be on Kinesis Streams, then you can configure it to be consumed by Firehose.
When you need to collect data from real devices, you can use AWS IoT Core for the entry point for your data. Your devices can have the AWS IoT Device SDK in your preferred programming language to publish data to AWS IoT Core data plane. AWS IoT Core offers Rules feature to forward data to AWS services. So you can configure Kinesis Data Streams Rule to forward incoming data to Amazon Kinesis Data Streams. In this case, AWS IoT Core service will be the place where Kinesis PutRecord API is called, instead of your custom script on the simuation use-case.
if you open to use some opensource tools like fluentbit - it is relatively straightforward to generate some random data and push it to kinesis firehose
https://docs.fluentbit.io/manual/pipeline/inputs/dummy
Conteúdo relevante
- AWS OFICIALAtualizada há um ano
- AWS OFICIALAtualizada há 2 meses
- AWS OFICIALAtualizada há 2 anos