Hands-On Infrastructure Monitoring with Prometheus

Silencing

Silencing is a common concept in monitoring/alerting systems; it is how you can avoid alert notifications from going out in a time-capped way. It is often used to disable notifications during maintenance windows, or to temporarily suppress alerts of lower importance during incidents. Alertmanager takes this concept and supercharges it by taking advantage of the fact that alerts coming in usually have one or more differentiating labels: ones from the originating alerting rule expression, the alertname, the alert's label fields, from alert_relabel_configs, as well as the ones from the Prometheus external_labels. This means that any one of these labels (or a combination of them) can be used to temporarily disable notifications through ...