1 Introduction to machine learning1.1 Different paradigms1.2 Supervised learning1.3 Model selection1.4 No-free-lunch theorem1.5 ML pipeline in practice1.6 Implementation details2 Probability review2.1 Motivation2.2 Probability space2.3 Independence and conditioning2.4 Random variables2.5 Discrete random variables2.6 Continuous random variables2.7 Moments2.8 Samples from an unknown distribution3 Optimization3.1 Definitions3.2 Gradient-based algorithms3.3 Nonconvex case3.4 Constrained optimization: duality theory