Conclusion

In this book we've tried to demonstrate the power of what A/B testing can bring to your own organization. We've seen examples from companies and teams across a number of fields: what they tried, what they learned, and how a few simple questions turned into a cultural sea change.

We've explored some of the most important overarching principles for A/B testing. We showed the importance of defining quantifiable success metrics, and why you should seek the global maximum. By looking at case studies, we uncovered the idea that sometimes less is more, and that words matter. Not every single test, of course, will be an instant success, which is why it's important to fail fast and learn. And we hope we've persuaded you that the best time to start is today.

We've laid out a roadmap that starts by choosing a testing solution that's right for you. In month one you should identify your first experiment and get buy-in from your company's stake-holders and decision makers. The evolution continues in months two to five as you build a testing culture, a team, and a process within your organization. And from month six and beyond, we've outlined some of the components of building out a long-term strategy that includes testing as an ongoing iterative process that is wedded not only to evaluation but to creativity and design as well.

We've also explored some advanced topics in A/B testing, such as potential cautions and hazards you may encounter along the way, how to take testing beyond ...

Get A/B Testing: The Most Powerful Way to Turn Clicks Into Customers now with the O’Reilly learning platform.

O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.