Book description
For companies such as Amazon, Dropbox, and Gremlin, the term high severity incident (SEV) signifies drops in network availability, product feature issues, data loss, revenue loss, and security risks. These high-impact bugs occur when coding, automation, testing, and other engineering practices create issues that eventually reach the customer—issues that can exist without detection for hours, days, weeks, and even years.
With this in-depth ebook, SREs, SRE managers, VPs of engineering, and CTOs will learn powerful methods for reducing MTTD through incident classification and leveling, tooling, monitoring, KPI metrics, alerting, observability, and chaos engineering. The authors share real-life experiences to explain how they achieved MTTD reduction results for companies including Gremlin, LinkedIn, Twitter, Amazon Web Services, Fuzzbox, and Samba TV.
This ebook dives into:
- Incident classification: SEV descriptions and levels, and SEV and time-to-detection (TTD) timelines
- Organization-wide critical service monitoring, including key dashboards and KPI metrics emails
- Service ownership and metrics for organizations maintaining a microservice architecture
- Effective on-call principles for site reliability engineers, including rotation structure, alert threshold maintenance, and escalation practices
- Chaos engineering practices to identify random and unpredictable behavior in your system
- Monitoring and metrics to detect incidents caused by self-healing systems
- Creating a high-reliability culture by listening to people in your organization
Table of contents
-
Reducing Mean Time to Detection for High-Severity Incidents
- Introduction
- Step 0: Incident Classification
- Step 1: Organization-Wide Critical-Service Monitoring
- Critical-Service KPI Metrics Emails
- Step 2: Service Ownership and Metrics
- Step 3: On-Call Principles
- Step 4: Chaos Engineering
- Step 5: Detecting Incidents Caused by Self-Healing Systems
- Step 6: Listening to Your People and Creating a High-Reliability Culture
- Conclusion
- Further Reading on Reducing MTTD for High-Severity Incidents
Product information
- Title: Reducing MTTD for High-Severity Incidents
- Author(s):
- Release date: December 2018
- Publisher(s): O'Reilly Media, Inc.
- ISBN: 9781492046196
You might also like
book
40 Algorithms Every Programmer Should Know
Learn algorithms for solving classic computer science problems with this concise guide covering everything from fundamental …
book
Software Engineering at Google
Today, software engineers need to know not only how to program effectively but also how to …
book
Head First Design Patterns, 2nd Edition
You know you don’t want to reinvent the wheel, so you look to design patterns—the lessons …
book
Observability Engineering
Observability is critical for engineering, managing, and improving complex business-critical systems. Through this process, any software …