5 Dealing with noisy tests

In this chapter

  • explaining why tests are crucially important to CD
  • creating and executing a plan to go from noisy test failures to a useful signal
  • understanding what makes tests noisy
  • treating test failures as bugs
  • defining flaky tests and understanding why they are harmful
  • retrying tests appropriately

It’d be nearly impossible to have continuous delivery (CD) without tests! For a lot of folks, tests are synonymous with at least the CI side of CD, but over time some test suites seem to degrade in value. In this chapter, we’ll take a look at how to take care of noisy test suites.

Continuous delivery and tests

How do tests fit into CD? From chapter 1, CD is all about getting to a state where

  • you can safely deliver ...

Get Grokking Continuous Delivery now with the O’Reilly learning platform.

O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.