A/B TestingWhy Have a Control Group?Why Just A/B? Why Not C, D…?For Further ReadingHypothesis TestsThe Null HypothesisAlternative HypothesisOne-Way, Two-Way Hypothesis TestFurther ReadingResamplingPermutation TestExample: Web StickinessExhaustive and Bootstrap Permutation TestPermutation Tests: The Bottom Line for Data ScienceFor Further ReadingStatistical Significance and P-ValuesP-ValueAlphaType 1 and Type 2 ErrorsData Science and P-ValuesFurther Readingt-TestsFurther ReadingMultiple TestingFurther ReadingDegrees of FreedomFurther ReadingANOVAF-StatisticTwo-Way ANOVAFurther ReadingChi-Square TestChi-Square Test: A Resampling ApproachChi-Square Test: Statistical TheoryFisher’s Exact TestRelevance for Data ScienceFurther ReadingMulti-Arm Bandit AlgorithmFurther ReadingPower and Sample SizeSample SizeFurther ReadingSummary