What time period does AWS anomaly detection train on?

0

The metric we are monitoring has data going back ~2 years. The anomaly detection band has some weird artifacts.

How far back do we need to consider for adding time ranges to exclude.

I also observed when we enable anomaly detection, the band narrows/constricts after ~a week or two. Why is this?

Thanks.

1 Answer
0
Accepted Answer

Check out our user guide for Amazon CloudWatch Anomaly Detection. It mentions

After you create an alarm, you can adjust the anomaly detection model. You can exclude certain time periods from being used in the model creation. It is critical that you exclude unusual events such as system outages, deployments, and holidays from the training data. You can also specify whether to adjust the model for Daylight Savings Time changes.

As for your band narrowing after a week or so, the band represents the expected "normal" range for the metric values. Check out this Knowledge Center article that dives a bit more into that. Here's the important section:

After you create a model, CloudWatch anomaly detection continually evaluates the model and makes adjustments. It does this to make sure that its analysis is as accurate as possible. If another anomaly detection model that is trained with the most recent data performs better than the current model, then CloudWatch anomaly detection switches to the new model. This can cause the anomaly detection bands to shift

Essentially, you're training your model on data that includes unusual events. This creates a large band to account for the unusual data points. As time goes on the model is regularly retrained on current data points, which narrows the band, making your model more accurate at recognizing abnormalities. Just use data points that accurately portray what "normal" looks like and it will successfully train and retrain your model as time goes on.

AWS
AWSJoe
answered 5 months ago
  • Sure, but how far back does the model go? I'm wondering if I need to go through the last 5 years of metrics data to exclude every abnormal event or if the period is something like 2 months

  • The algorithm trains on up to two weeks of metric data, but you can enable anomaly detection on a metric even if the metric does not have a full two weeks of data.

    After you create a model, CloudWatch anomaly detection continually evaluates the model and makes adjustments to it to ensure that it is as accurate as possible. This includes re-training the model to adjust if the metric values evolve over time or have sudden changes, and also includes predictors to improve the models of metrics that are seasonal, spiky, or sparse.

    Source: https://docs.aws.amazon.com/AmazonCloudWatch/latest/monitoring/CloudWatch_Anomaly_Detection.html

You are not logged in. Log in to post an answer.

A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.

Guidelines for Answering Questions