AWS Builder Center: Learn, Build and Connect with builders in the AWS community

AWS Builder Center is the official home for builders on AWS. Share and read what others are working on, follow people who inspire you, explore training and workshops, and find tools to support what you're building.

All Content tagged with Amazon Managed Streaming for Apache Kafka (Amazon MSK)

Amazon MSK makes it easy to ingest and process streaming data in real time with fully managed Apache Kafka.

Content language: English

Filter content

Select tags to filter

Sort by

Sort by most recent

396 results

"Topic not present in metadata after 60000 ms" on Amazon MSK...

Hyangmok BaekSUPPORT ENGINEER

published 13 days ago0 votes53 views

When a Kafka producer fails with TimeoutException: Topic ... not present in metadata after 60000 ms, most people check whether the topic exists or whether the network is broken. But this error also oc...

ARTICLE

EventBridge Pipes + MSK Serverless source: "requires outboun...

I have an EventBridge Pipe (`my-pipe`) using an MSK Serverless cluster (`my-msk-cluster`, ACTIVE) as a source, targeting a CloudWatch Logs group. It's stuck in this state: ``` PROBLEM: Pipe VPC event...

Amazon EventBridge Pipes Amazon Managed Streaming for Apache Kafka (Amazon MSK)Amazon EventBridge

answers

votes

views

Wei Han

asked 14 days ago

Authenticate to Amazon MSK with Google OAuth/OIDC via AWS We...

Masudur Rahaman SayemEXPERT

published 25 days ago0 votes69 views

This post shows how to authenticate a Kafka client to Amazon MSK using a Google OAuth/OIDC identity, with no long-lived AWS keys.

ARTICLE

Amazon Managed Streaming for Apache Kafka (Amazon MSK)

How much do Kafka transactions cost you on Amazon MSK Expres...

Hyangmok BaekSUPPORT ENGINEER

published a month ago0 votes74 views

Cluster sizing for MSK Express brokers is usually calculated from the official per-broker throughput quotas. But workloads that use Kafka transactions hit a different bottleneck - commit processing - ...

ARTICLE

Amazon Managed Streaming for Apache Kafka (Amazon MSK)

Five operational differences to check before adopting Amazon...

Hyangmok BaekSUPPORT ENGINEER

published a month ago0 votes109 views

Express brokers offer up to 3x throughput per broker, 20x faster scaling, and no storage management. But if you operate them the way you operate Standard brokers, you will run into unexpected behavior...

ARTICLE

Amazon Managed Streaming for Apache Kafka (Amazon MSK)

Why adding consumers won't fix your consumer lag on Amazon M...

Hyangmok BaekSUPPORT ENGINEER

published a month ago1 votes105 views

When consumer lag spikes, the usual reaction is to add consumers or partitions. But when lag piles up on a single partition, scaling out does not help and can even make things worse: the cause is not ...

ARTICLE

Amazon Managed Streaming for Apache Kafka (Amazon MSK)

Why doesn't kafka-delete-records reduce consumer lag on Amaz...

Hyangmok BaekSUPPORT ENGINEER

published a month ago1 votes124 views

When a consumer gets stuck on a problematic message, a common reaction is to delete that message from the topic. However, after running kafka-delete-records.sh, the consumer lag number stays exactly t...

ARTICLE

Amazon Managed Streaming for Apache Kafka (Amazon MSK)

Why raising socket.receive.buffer.bytes on Amazon MSK does n...

Jeongho KimSUPPORT ENGINEER

published a month ago1 votes79 views

You raise `socket.receive.buffer.bytes` on your Amazon MSK brokers to 1 MiB or 2 MiB, but the TCP send window your producers observe and their throughput stay the same. This article explains why the b...

ARTICLE

Amazon Managed Streaming for Apache Kafka (Amazon MSK)

After receiving an Amazon MSK security patching notification...

Jeongho KimSUPPORT ENGINEER

published 2 months ago0 votes93 views

For operators who, after receiving an Amazon MSK security patching notification, want to know whether the patch will affect their cluster and whether the schedule can be moved or skipped. It covers ho...

ARTICLE

Amazon Managed Streaming for Apache Kafka (Amazon MSK)

What to do when you receive the AWS_KAFKA_HIGH_RISK_CONFIG_R...

Jeongho KimSUPPORT ENGINEER

published 3 months ago0 votes192 views

This article explains the AWS Health event `AWS_KAFKA_HIGH_RISK_CONFIG_RF_EQUALS_MINISR` for Amazon MSK and how to respond. It is a proactive notification that your cluster has topics where the replic...

ARTICLE

Amazon Managed Streaming for Apache Kafka (Amazon MSK)

Introduction to Access Control with Amazon Managed Streaming...

On the “Data Engineering on AWS - A Streaming Data Pipeline Solution (Includes Labs)” activity, on the second lab, “Introduction to Access Control with Amazon Managed Streaming for Apache Kafka”, when...

Amazon Managed Streaming for Apache Kafka (Amazon MSK)Training and Certification

answers

votes

127

views

Tamara Bailey

asked 4 months ago

Automated Kafka update triggered by AWS has broken our clust...

I found out today (2026-05-06) that our Kafka service is broken Upgrade Apache Kafka version In progress - 50% Started 23 April 2026 at 16:44 UTC How can this be addressed ... I can't find contact...

Amazon Managed Streaming for Apache Kafka (Amazon MSK)

answers

votes

207

views

memura

asked 4 months ago

1
2
3
4
5
•••
33
Page size
12 / page