The Fundamentals of Telemetry Pipelines

Table of contents

1. Preface
2. 1. The Need for Telemetry Pipelines
   1. Making Sense of the Madness: A Telemetry Pipeline in Action
      1. Optimized for Agility…
      2. …Ready for Scale…
      3. …Ready for Disaster
   2. Learning from Our Incident
   3. Crafting the Flood: From Seeing to Observing
   4. Mastering the Flood with a Telemetry Pipeline
   5. Rich, Useful, Timely, Secure
   6. An Investment, Not a Free Lunch
3. 2. The Domain Language of Telemetry Pipelines
   1. The Building Blocks of Telemetry Pipelines
      1. Starting at the Source
      2. What’s the Destination?
      3. Do Cross the Streams: From Sources to Destinations
      4. Adding Processors
   2. Bringing It All Together
4. 3. Managing Your Telemetry Pipelines
   1. Managing and Debugging Your Pipelines
      1. Getting a Grip: Ingress and Egress Data Volumes
      2. Taking a Peek: Debugging with Pipeline Taps
   2. Debugging Your Pipeline
   3. From Control and Management to Business Value
5. 4. Containing the Cost
   1. Processors Are the Key
      1. Deduplicate Where You Can
      2. Choose Your Route Carefully
      3. Reduce, Sample, or Filter It Down (Carefully)
      4. Converting Events or Logs to Metrics
   2. Cost, Controlled
6. 5. Embracing Compliance
   1. The Key Is Processors, Once Again!
   2. The Case of Conformance to GDPR
   3. Helping with Compliance: Another Telemetry Pipeline Payoff
7. 6. Conclusion
8. About the Author