Chapter 5New Metrics That Matter for Growth

In God we trust, all others bring data.1

W. Edwards Deming, American engineer, statistician, author, and esteemed quality consultant

An astonishing 50 percent of the 3,000 medical treatments that have been studied around the world in controlled, randomized trials are of unknown effectiveness—in other words, we have absolutely no idea how well they work, or if they work at all!2 Worse still, this doesn't mean that the other 50 percent actually work. A study by Clinical Evidence, a project of the British Medical Journal, finds that only one-third of treatments are likely to be beneficial: Specifically, 11 percent have been shown to be beneficial, and 23 percent are likely to be beneficial. Of the remainder, 7 percent have trade-offs between harms and benefits, 6 percent are unlikely to be beneficial, and 3 percent are likely to be ineffective or even harmful.3

These numbers are shockingly bad. How is it possible that an industry filled with highly educated individuals and whose success can be objectively observed in the health of its customers (i.e., patients) would rely on so many unproven treatments? The reality is that ideology and tradition get in the way of medical evidence all the time.4 In fact, research indicates that an abysmal 15 percent of doctors' decisions are based on factual evidence.5 To quote Dr. David Newman, director of clinical research at Mt. Sinai School of Medicine:6

Treatment based on ideology is alluring. ...

Get The Wallet Allocation Rule now with the O’Reilly learning platform.

O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.