How Long Should My Test Run?

We are often asked how long a landing page optimization test should last. The answer depends on the following factors:

  • The data rate (number of conversions per day)
  • Size of improvements found (percentage improvement)
  • Size of your test (number of alternative designs)
  • The confidence in your answer (how sure you need to be)

We have already covered the last factor in the “How Sure Do I Need to Be?” section. Let’s take a look at the other ones next.

Data Rate

The data rate describes how quickly you collect data during your test. Many people are familiar with common metrics of web traffic such as the number of page views or the number of unique visitors. The volume of traffic for landing page optimization tests is best ...

Get Landing Page Optimization: The Definitive Guide to Testing and Tuning for Conversions, 2nd Edition now with the O’Reilly learning platform.

O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.