4 Response surface methodology: Optimizing continuous parameters
This chapter covers
- Designing experiments to optimize continuous parameters
- Modeling your business metric as a function of system parameters
- Optimizing over the model
- Validating the optimal parameter settings
A/B tests are straightforward and reliable. They are the “gold standard” of experiments, but there is a cost—that is, the time, money, or risk involved in obtaining experimental results—to running them. Each of chapters 3-6 presents a method that aims to reduce that cost. For example, multi-armed bandits (MAB) adapt the experiment design continuously as new individual measurements are taken, and this reduces the time spent running the inferior version—A or B—of the system. ...
Get Experimentation for Engineers now with the O’Reilly learning platform.
O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.
