6

Data Distribution and Processing

In the previous chapter, we explored the architecture of data pipelines, understanding their role as the circulatory system for observability data. In this chapter, we’ll dive deeper into the specific processes of data distribution and processing. Think of a retail warehouse where online purchases result in items being picked, packaged, labeled with order details, and then distributed to their destinations via conveyor belts:

Figure 6.1 – Warehouse distribution and processing example

Figure 6.1 – Warehouse distribution and processing example

Similarly, in telemetry and observability, data collected from metrics, logs, flows, and events in general undergoes a parallel ...

Get Modern Network Observability now with the O’Reilly learning platform.

O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.