Video description
Testing in production has gotten a bad rap. People act like testing in production implies you aren’t doing due diligence with your tests before production. But it’s more like a fact of life: you can only catch the easy bugs in staging—the known-unknowns, the things you predicted would fail, and the things that have failed before. Which isn’t nothing, but it’s no better than running tests on your laptop.
Most interesting problems are only going to manifest under real workloads, on real data, with real users doing unpredictable things under real concurrency and resource pressure. So you should use much fewer of your scarce engineering cycles poring over staging and much more of them building guard rails for prod. Production—where your customers live—is the only environment that matters. Time spent interacting with nonprod systems is wasted time. Replicas are not valuable for helping build your instincts, your skill set, your intuition. Secondary environments actually train you to expect faulty assumptions and to take dangerous shortcuts and run terrifying commands. You should force people to develop and test on production as much as possible and interact with production every day.
Charity Majors (Honeycomb) dives into tooling and shares ways to harden production and make it safe for engineers to do their work directly on it—from deploys and canarying to feature flags, instrumentation and observability, human practices and workflows, and much more.
This session was recorded at the 2019 O'Reilly Velocity Conference in San Jose.
Product information
- Title: Test in production: Yes, you can (and you should)
- Author(s):
- Release date: October 2019
- Publisher(s): O'Reilly Media, Inc.
- ISBN: 0636920338345
You might also like
video
Anatomy of testing in production: A Netflix original case study
So you want to test your complex application that involves large-scale distributed systems. But how do …
video
Agile Testing Essentials
4+ Hours of Video Instruction is based on fundamental concepts from Lisa Crispin’s and Janet Gregory’s …
book
Effective Software Testing
Go beyond basic testing! Great software testing makes the entire development process more efficient. This book …
book
Unit Testing Principles, Practices, and Patterns
Unit Testing Principles, Patterns and Practices shows you how to refine your existing unit tests by …