Skip to Content
Building Resilient Distributed Systems
book

Building Resilient Distributed Systems

by Sam Newman
September 2026
Intermediate to advanced
390 pages
11h 2m
English
O'Reilly Media, Inc.
Content preview from Building Resilient Distributed Systems

Chapter 14. Incident Management and Post-Incident Response

You may encounter many defeats, but you must not be defeated. In fact, it may be necessary to encounter the defeats, so you can know who you are, what you can rise from, how you can still come out of it.

Maya Angelou

Incident response has two clear goals. The first is to get the system up and running as quickly as possible. The second is to capture enough information to identify ways in which the system (in a sociotechnical sense) can learn and adapt.

Broadly speaking, this chapter is split into two parts. First, I’ll look at the process of handling an incident and its immediate aftermath. Second, I’ll look at the process of post-incident review, and at how to make sure you create the best opportunities to learn from what happens.

I also want to be clear that this chapter is not intended to be an exhaustive discussion of incident management. Where applicable, I’ve added references to other resources from which you can learn more. My main goal in this chapter is to help you see incident management as an extension of the ideas of resilience engineering as a whole, a process in which dealing with surprise and continual learning is key to building more resilient systems. I’ll also show how incident management doesn’t follow a simple, structured workflow—like our distributed systems, it can be a messy, multifaceted affair.

Before that, though, we should probably define what an incident is. Oddly enough, this is not as clear-cut ...

Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.

Read now

Unlock full access

More than 5,000 organizations count on O’Reilly

AirBnbBlueOriginElectronic ArtsHomeDepotNasdaqRakutenTata Consultancy Services

QuotationMarkO’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.
Julian F.
Head of Cybersecurity
QuotationMarkI wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.
Addison B.
Field Engineer
QuotationMarkI’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.
Amir M.
Data Platform Tech Lead
QuotationMarkI'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.
Mark W.
Embedded Software Engineer

You might also like

Patterns of Distributed Systems

Patterns of Distributed Systems

Unmesh Joshi

Publisher Resources

ISBN: 9781098163532Errata Page