“Does QA Match Production?”

File this question under, “I wish I had a nickel.” Anytime a deployment fails or some bug surfaces in production, people will naturally ask why the issue wasn’t discovered during testing. It is an important question to ask and answer. Nine times out of ten, the immediate corollary question will be, “Are there any differences in configuration between QA and production?”

This question is what I call a “gimme.” It is easy to ask, very expensive to answer, and guaranteed to find something different such as hostnames and IP addresses, if nothing else. You might be thinking, “Why should that be expensive to answer? Isn’t that what configuration management systems are all about?” Yes and no. Configuration ...

Get Release It! now with the O’Reilly learning platform.

O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.