Hands-On Infrastructure Monitoring with Prometheus

Prometheus configuration

There are a couple of configurations that need to be done in Prometheus so that we can start using Alertmanager. The first thing to do is configure the external labels, which are labels that are added to time series data (if it doesn't already have them) when communicating with external systems, including but not limited to Alertmanager. These are labels that uniquely identify the origin of the metrics, such as region, datacenter, or environment. As a rule of thumb, if you feel tempted to add the same label name/value to every single scrape and recording rule, that label would probably make more sense as an external label as it introduces no dimension to metrics locally in your Prometheus instance, but would most ...