book

Prometheus: Up & Running

by Brian Brazil

July 2018

Beginner to intermediate

386 pages

9h 6m

English

O'Reilly Media, Inc.

Read now

Unlock full access

Expanding the KnownConventions Used in This BookUsing Code ExamplesO’Reilly SafariHow to Contact UsAcknowledgments
What Is Monitoring?A Brief and Incomplete History of MonitoringCategories of MonitoringPrometheus ArchitectureClient LibrariesExportersService DiscoveryScrapingStorageDashboardsRecording Rules and AlertsAlert ManagementLong-Term StorageWhat Prometheus Is Not
Running PrometheusUsing the Expression BrowserRunning the Node ExporterAlerting
A Simple ProgramThe CounterCounting ExceptionsCounting SizeThe GaugeUsing GaugesCallbacksThe SummaryThe HistogramBucketsUnit Testing InstrumentationApproaching InstrumentationWhat Should I Instrument?How Much Should I Instrument?What Should I Name My Metrics?
PythonWSGITwistedMultiprocess with GunicornGoJavaHTTPServerServletPushgatewayBridgesParsersExposition FormatMetric TypesLabelsEscapingTimestampscheck metrics
What Are Labels?Instrumentation and Target LabelsInstrumentationMetricMultiple LabelsChildAggregatingLabel PatternsEnumInfoWhen to Use LabelsCardinality
InstallationData SourceDashboards and PanelsAvoiding the Wall of GraphsGraph PanelTime ControlsSinglestat PanelTable PanelTemplate Variables

CPU CollectorFilesystem CollectorDiskstats CollectorNetdev CollectorMeminfo CollectorHwmon CollectorStat CollectorUname CollectorLoadavg CollectorTextfile CollectorUsing the Textfile CollectorTimestamps
Service Discovery MechanismsStaticFileConsulEC2RelabellingChoosing What to ScrapeTarget LabelsHow to Scrapemetric_relabel_configsLabel Clashes and honor_labels
cAdvisorCPUMemoryLabelsKubernetesRunning in KubernetesService Discoverykube-state-metrics
ConsulHAProxyGrok ExporterBlackboxICMPTCPHTTPDNSPrometheus Configuration
Other Monitoring SystemsInfluxDBStatsD
Consul TelemetryCustom CollectorsLabelsGuidelines
Aggregation BasicsGaugeCounterSummaryHistogramSelectorsMatchersInstant VectorRange VectorOffsetHTTP APIqueryquery_range
GroupingwithoutbyOperatorssumcountavgstddev and stdvarmin and maxtopk and bottomkquantilecount_values
Working with ScalarsArithmetic OperatorsComparison OperatorsVector MatchingOne-to-OneMany-to-One and group_leftMany-to-Many and Logical OperatorsOperator Precedence
Changing TypevectorscalarMathabsln, log2, and log10expsqrtceil and floorroundclamp_max and clamp_minTime and Datetimeminute, hour, day_of_week, day_of_month, days_in_month, month, and yeartimestampLabelslabel_replacelabel_joinMissing Series and absentSorting with sort and sort_descHistograms with histogram_quantileCountersrateincreaseirateresetsChanging Gaugeschangesderivpredict_lineardeltaideltaholt_wintersAggregation Over Time
Using Recording RulesWhen to Use Recording RulesReducing CardinalityComposing Range Vector FunctionsRules for APIsHow Not to Use RulesNaming of Recording Rules
Alerting RulesforAlert LabelsAnnotations and TemplatesWhat Are Good Alerts?Configuring AlertmanagersExternal Labels
Notification PipelineConfiguration FileRouting TreeReceiversInhibitionsAlertmanager Web Interface
Planning a RolloutGrowing PrometheusGoing Global with FederationLong-Term StorageRunning PrometheusHardwareConfiguration ManagementNetworks and AuthenticationPlanning for FailureAlertmanager ClusteringMeta- and Cross-MonitoringManaging PerformanceDetecting a ProblemFinding Expensive Metrics and TargetsReducing LoadHorizontal ShardingManaging ChangeGetting Help

Content preview from Prometheus: Up & Running

Part I. Introduction

This section will introduce you to monitoring in general, and Prometheus more specifically.

In Chapter 1 you will learn about the many different meanings of monitoring and approaches to it, the metrics approach that Prometheus takes, and the architecture of Prometheus.

In Chapter 2 you will get your hands dirty running a simple Prometheus setup that scrapes machine metrics, evaluates queries, and sends alert notifications.