Questions tagged with Amazon Managed Streaming for Apache Kafka (Amazon MSK)
Amazon MSK makes it easy to ingest and process streaming data in real time with fully managed Apache Kafka.
Content language: English
Select up to 5 tags to filter
Sort by most recent
Browse through the questions and answers listed below or filter and sort to narrow down your results.
Hi,
We're currently building an MSK cluster. We use 2 types of authentication for 2 different clients.
The IAM authentication works fine.
But for the SASL/SCRAM authentication that it's not the...
I want to horizontally autoscale the AWS MSK cluster but only found documentation related to storage autoscaling. Is there any way to autoscale the AWS MSK cluster ? Any reference to docs or any...
I am using kafka, kafka connect and debezium to cdc data between 2 postgres databases.
I want to switch to AWS MSK, what combination of services can I use to achieve the above goal
I have to create a...
See https://docs.aws.amazon.com/msk/latest/developerguide/limits.html. Could you please explain what "connection rate bursts" is? If I google for it, I get just this page and the link mentioned here....
I have a public reachable Self-Managed Kafka server, sitting on a public subnet. I have created an EventBridge pipe that connects to a topic, reads messages and sends them to an SQS queue. After 24...
Hi AWS,
I noticed msk replicator **source msk ** prerequisite changed to be with auth enable and version above 2.7.0.
I want to replicate from msk 2.2.1 to msk 3.5.1 is it something which will be...
We have an MSK cluster , let's call it test-cluster.
While using IAM authentication with confluent-kafka producer client in python, producer tries to write data using transactions to a kafka topic...
I'm testing the use of MSK Connect with IcebergSinkConnector, but I'm having some difficulty making it work. If anyone has experience with MSK and can help me, that would be great.
I have a topic in...
In the FAQ it could see the below content
**Q: How does data transfer pricing work?**
With provisioned clusters, you will pay standard AWS data transfer charges for data transferred in and out of an...
if it's possible to run Kafka and configure ACLs while disabling SSL?
What is the problem with connecting to the Kafka bootstrap address and reporting this error?
@timestamp":"2024-02-28T11:08:51.795Z","caller":"kq/pusher.go:45"'content":"unexpected EOF: broker appears...
As of Sept, 2023 kinesis firehose supports creating delivery stream to consume MSK Topic data and store that into s3 with...