Skip to content

Incident Detection and Response (IDR)

Language: English
Content related to Incident Detection and Response (IDR)
6
Landing page for Incident Detection and Response (IDR) which includes articles to assist current and future IDR customers.

IDR Alarm Best Practices

AWS Incident Detection and Response provides 24/7 proactive monitoring for critical workloads. These guides provide CloudWatch alarm configurations that detect business impact - metric names, thresholds, and periods validated across IDR customer workloads.

Choose your path:

  • By Industry - Find alarm recommendations for your industry's workload patterns. See Customer Industries below.
  • By AWS Service - Get alarm configurations for a specific service. See AWS Service Alarms below.
  • Third-party APM - Integrate Dynatrace or Splunk with IDR. See IDR Guides below.

Quick Start: Start with Elastic Load Balancer, ECS/EKS, and RDS. These three layers cover the critical path for most workloads.


Critical Path Model

User -> CDN -> Load Balancer -> Compute -> Database
        |         |               |            |
    CloudFront   ELB           ECS/EKS        RDS

Alarm on services in the request path that directly impact end users.


IDR Alarm Best Practices - Customer Industries

Looking for baseline CloudWatch alarm recommendations by AWS service? See the AWS Service Alarms section below. The industry pages below identify which services sit on the critical path for your industry, why they matter, and where thresholds may differ from the defaults.

How to Use This Guide

  • Start with baseline alarms — Configure alarms for your core AWS services using the service-specific articles.
  • Find your industry below — Add industry-specific alarms and considerations from your industry page.
  • Request help — Contact your AWS account team or raise a support case for assistance identifying appropriate alarms for your workload.

Industries

IndustryKey Workload Patterns
SportsEvent-driven, live scoring, ticket sales
Retail & CPGFlash sales, seasonal peaks, order fulfillment
Financial ServicesReal-time transactions, compliance, low-latency
Healthcare & Life SciencesEHR systems, telemedicine, clinical data exchange
Media & EntertainmentLive streaming, VOD, content delivery
Telecommunications5G core, RAN, OSS/BSS
GamesMultiplayer, matchmaking, leaderboards
Public SectorEmergency response, social services, education
Energy & UtilitiesSCADA, grid monitoring, IoT telemetry
Automotive & ManufacturingConnected vehicles, supply chain, IoT
Travel & HospitalityBooking engines, loyalty, seasonal demand

Workload Patterns (Cross-Industry Guide)

Not sure which industry page fits your workload? Use the patterns below:

Workload PatternCharacteristicsRelevant IndustriesKey Alarm Strategy
Event-driven / BurstySpiky traffic tied to events or salesSports, Retail, GamesAnomaly detection, dynamic thresholds, pre-event validation
Steady-state / Mission-criticalConsistent traffic, zero-downtime requirementsHealthcare, Financial Services, Public SectorStatic thresholds, breaching on missing data, tight SLOs
Real-time StreamingLow-latency media or data deliveryMedia, Sports, GamesLatency-focused alarms, processing lag, buffer/queue metrics
IoT / EdgeHigh device count, telemetry ingestionAutomotive, Energy, TelcoConnection state, message throughput, device shadow metrics

IDR Alarm Best Practices - AWS Service Alarms

Production-ready CloudWatch alarm configurations for many AWS services. Each article provides metric names, statistics, periods, and thresholds.

Compute and Containers

ServiceDescription
EC2Detect instance status check failures
ECSContainer orchestration - detect running task count drops and CPU/memory saturation
EKSKubernetes clusters - detect pod failures, crash loops, node failures, and API server errors
LambdaDetect error rates, throttling, and concurrency limits
SageMakerML inference endpoints - detect invocation errors, model latency, and traffic drops

Networking and Content Delivery

ServiceDescription
API GatewayDetect 4XX/5XX error rates, latency, and integration errors
CloudFrontDetect elevated 5XX error rates from your CDN
Direct ConnectDedicated network link - detect connection state changes, errors, and bitrate drops
Elastic Load BalancerDetect 5XX spikes, unhealthy targets, and rejected connections
Network FirewallTraffic inspection - detect TLS inspection errors
Route 53Detect health check failures, DNSSEC issues, and resolver endpoint degradation
Transit GatewayCross-VPC networking - detect blackhole drops, no-route drops, and traffic loss
VPNDetect tunnel state changes (up/down)

Databases and Caching

ServiceDescription
Amazon AuroraDetect connection exhaustion, replication lag, read/write latency, and storage pressure
DynamoDB and DAXDetect system errors, read/write throttle events, latency, and replication lag
ElastiCacheIn-memory caching - detect memory saturation, connection spikes, and CPU utilization
OpenSearchSearch and analytics - detect cluster red status, storage exhaustion, and blocked writes
RDSDetect disk queue depth, storage exhaustion, replication lag, and read/write latency
RedshiftData warehouse - detect health status failures, disk space, and read/write latency

Messaging and Streaming

ServiceDescription
Amazon MQMessage broker - detect connection loss, storage exhaustion, and unacknowledged messages
Amazon MSKManaged Kafka - detect offline partitions, replication issues, and consumer lag
EventBridgeDetect failed invocations, DLQ delivery failures, and throttled rules
Kinesis Data StreamsReal-time streaming - detect throughput exceeded, iterator age growth, and failed records
SNSDetect notification failures, filtered-out messages, and DLQ redirects
SQSMessage queuing - detect queue backlog growth and stale messages
Step FunctionsDetect execution failures, timeouts, and throttled executions

Storage

ServiceDescription
EFS / FSxFile storage - detect I/O limits, throughput saturation, and storage capacity pressure
S3Detect 5XX errors, replication latency, and request latency

Migration

ServiceDescription
DMSDatabase migration - detect CDC replication delays and storage exhaustion

Specialty Services

ServiceDescription
Amazon ConnectContact center - detect concurrent capacity limits, contact flow errors, and recording failures
Amazon Lex V2Conversational AI - detect system errors, throttling, Lambda failures, and Polly errors
Elemental Media ServicesLive/VOD media - detect encoding quality drops, output 5XX errors, and transcoding failures
IoTDevice fleet communication - detect connection failures, publish errors, and throttling
OutpostsOn-premises AWS infrastructure - detect service link and BGP session failures

IDR Guides