All Content tagged with Amazon Kinesis Data Streams
Amazon Kinesis Data Streams is a serverless streaming data service that makes it easy to capture, process, and store data streams at any scale.
Content language: English
Filter content
Select tags to filter
Sort by
Sort by most recent
128 results
I’m currently using AWS Managed Service for Apache Flink to process streaming data coming from Amazon Kinesis Data Streams. While the service works well for real-time stream processing, the cost has b...
2
answers
0
votes
66
views
asked 21 days ago
I'm facing this issue with Stream Manager (v2.1.12) greengrass component when my RHEL VM is rebooted. On startup (since has an HARD dependency with Token Exchange Service) didn't start correctly and i...
2
answers
0
votes
50
views
asked a month ago
I'm working on building a real-time data pipeline on AWS to process data from IoT devices. Here's the architecture I'm aiming for:
1. AWS IoT Core receives data from edge devices.
2. Data is routed to...
1
answers
0
votes
128
views
asked 4 months ago
Hello!
**I'm trying to develop a telephone AI agent by using the following resources:**
- Amazon Connect
- Amazon Contact Lens
- Amazon Kinesis Data Streams
- Amazon Lambda
**After having created a...
2
answers
0
votes
457
views
asked 5 months ago
Hello,
I am using API Gateway REST to track custom events from different e-commerce stores. The endpoint then posts the data to Kinesis firehose, which will batch the records to S3.
Flow: API gateway...
2
answers
0
votes
223
views
asked 6 months ago
I'm migrating data from one DynamoDB table in one account to DynamoDB table in another account. I'm following the strategy as in the blog below: https://aws.amazon.com/blogs/database/cross-account-rep...
2
answers
0
votes
173
views
asked 8 months ago
Hello!
I have a system design / architecture problem.
Context:
The ultimate goal is to ingest battery data from an MQTT broker -> process this data to keep track of each data points state (charging,...
1
answers
0
votes
316
views
asked 9 months ago
A company has one million users that use its mobile app. The company must analyze the data usage in near-real time. The company also must
encrypt the data in near-real time and must store the data in ...
2
answers
0
votes
181
views
asked 9 months ago
I am using AWS Database Migration Service (DMS) to replicate Change Data Capture (CDC) data from Aurora PostgreSQL Serverless to Amazon Kinesis Data Streams. My Aurora PostgreSQL source endpoint works...
1
answers
0
votes
285
views
asked 9 months ago
My previous post: [https://repost.aws/questions/QUj4XJYpDOSIKftobhiOsNpQ#ANzFBcnc_-SHCxxAuNMWPvIw
]()
We're building a custom Node.js consumer for Kinesis Data Streams and intentionally avoiding KCL d...
1
answers
0
votes
81
views
asked 10 months ago
I'm working on a Node.js application that polls from AWS Kinesis and pushes to Event Hubs. We have multiple poller instances where each poller needs to handle certain shards. Currently, we distribute ...
2
answers
0
votes
342
views
asked 10 months ago
For our Kinesis Data Streams setup, we're observing automatic retries on throttling errors, specifically `ProvisionedThroughputExceededException`. We have our own exponential backoff mechanism in plac...
1
answers
0
votes
1.1K
views
asked 10 months ago