The task of trying to assess the impact of random variability on the conclusion drawn from a study, or the results of a measurement, is called statistical inference. In this chapter, we look at a particular kind of statistical inference called a hypothesis test. Generally, a hypothesis test seeks to determine whether the effects we see in some data from a study are real or might just be the result of chance variation.
Who uses hypothesis testing? The research community uses it to determine whether a study is worthy of publication or regulatory approval. Data scientists are in less need of the formal apparatus of hypothesis testing but they do use the resampling methods presented here, and their variants, to help separate random from “real” patterns in data.
After completing this chapter, you should be able to
The standard hypothesis-testing procedure involves a what-if calculation. We ask, “Could my results be due to chance?” This supposition is called the null hypothesis. Null is an old-fashioned word ...