Help improve AWS Support Official channel in re:Post and share your experience - complete a quick three-question survey to earn a re:Post badge!
All Content tagged with Amazon Kinesis Data Streams
Amazon Kinesis Data Streams is a serverless streaming data service that makes it easy to capture, process, and store data streams at any scale.
Content language: English
Select tags to filter
Sort by most recent
124 results
I'm migrating data from one DynamoDB table in one account to DynamoDB table in another account. I'm following the strategy as in the blog below: https://aws.amazon.com/blogs/database/cross-account-rep...
Hello!
I have a system design / architecture problem.
Context:
The ultimate goal is to ingest battery data from an MQTT broker -> process this data to keep track of each data points state (charging,...
A company has one million users that use its mobile app. The company must analyze the data usage in near-real time. The company also must
encrypt the data in near-real time and must store the data in ...
I am using AWS Database Migration Service (DMS) to replicate Change Data Capture (CDC) data from Aurora PostgreSQL Serverless to Amazon Kinesis Data Streams. My Aurora PostgreSQL source endpoint works...
My previous post: [https://repost.aws/questions/QUj4XJYpDOSIKftobhiOsNpQ#ANzFBcnc_-SHCxxAuNMWPvIw
]()
We're building a custom Node.js consumer for Kinesis Data Streams and intentionally avoiding KCL d...
I'm working on a Node.js application that polls from AWS Kinesis and pushes to Event Hubs. We have multiple poller instances where each poller needs to handle certain shards. Currently, we distribute ...
For our Kinesis Data Streams setup, we're observing automatic retries on throttling errors, specifically `ProvisionedThroughputExceededException`. We have our own exponential backoff mechanism in plac...
What are the main differences between a Data Lake and a Data Warehouse in AWS? I am working on a project and would like guidance on how to decide which one is better suited for specific use cases and ...
asked 4 months ago
I am currently using AWS Lambda as a consumer for my Kinesis Data Streams. Here are the details of my setup:
- **Kinesis Stream Configuration:**
- **Number of Shards:** 8
- **Event Source Setting...
We have some IoT devices using AWS IoT Core that send data every 15 min to a lambda that deserializes and uploads to a Timestream database. I recently came across Kinesis Data Streams and it sounds l...
Description:
We're seeking clarification on the behavior of GetIteratorAge metric in Kinesis Data Streams (KDS), as we're observing what appears to be unexpected behavior with iterator aging.
Current...
Description:
We are experiencing consistent throttling with our Kinesis Data Stream (KDS) and seeking guidance on the root cause and resolution. Our key observations suggest the throttling behavior mi...