Measuring the Impact of an Experiment

A metric is a data point. This data point represents something the team wants to observe and understand—for instance, clicks and impressions of images on a website. Or a metric could represent a business-oriented data point, such as revenue and subscription upsells. Metrics are the key to demonstrating the effect of your changes to the product.

Gauging an Effective Metric

When you build a solution that solves a problem, you usually hedge a bet that your solution will address the problem. How are you going to ensure that’s the case? Well, with an A/B test. The metrics that are defined as part of your test configuration will help demonstrate the impact of the change to your product.

Qualities that define a ...

Get Practical A/B Testing now with the O’Reilly learning platform.

O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.