A/B TestingWhy Have a Control Group?Why Just A/B? Why Not C, D,…?Further ReadingHypothesis TestsThe Null HypothesisAlternative HypothesisOne-Way Versus Two-Way Hypothesis TestsFurther ReadingResamplingPermutation TestExample: Web StickinessExhaustive and Bootstrap Permutation TestsPermutation Tests: The Bottom Line for Data ScienceFurther ReadingStatistical Significance and p-Valuesp-ValueAlphaType 1 and Type 2 ErrorsData Science and p-ValuesFurther Readingt-TestsFurther ReadingMultiple TestingFurther ReadingDegrees of FreedomFurther ReadingANOVAF-StatisticTwo-Way ANOVAFurther ReadingChi-Square TestChi-Square Test: A Resampling ApproachChi-Square Test: Statistical TheoryFisher’s Exact TestRelevance for Data ScienceFurther ReadingMulti-Arm Bandit AlgorithmFurther ReadingPower and Sample SizeSample SizeFurther ReadingSummary