Takeaways
There’s only one way to prove that the optimization worked. You measure the performance before and after, and you compare. But the devil is in the details. Here’s what you need to take care of to get the measurements right.
-
Minimize external factors to increase measurement accuracy.
-
Make sure that GC behaves as predictably as possible to decrease variability in measurements.
-
Take as many measurements as practical to make statistical analysis possible. A good default is 30.
-
Compare before and after numbers by calculating the confidence interval of the optimization effect. Conclude that optimization worked only when the lower bound of the confidence interval is higher than 0.
-
Try to reduce dispersion in measurements as much ...
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.
Read now
Unlock full access