5.1 Linear Regression5.1.1 Simple Linear Regression5.1.2 Multiple Linear Regression5.1.3 Polynomial Regression5.2 Logistic RegressionWorking PrincipleAdvantagesLimitationsApplicationsExampleExample5.2.1 Binary Classification5.2.2 Multiclass Classification5.2.3 Regularization in Logistic Regression5.3 Decision Trees and Random ForestsDecision TreesRandom ForestsApplications5.3.1 Building Decision Trees5.3.2 Entropy and Information Gain5.3.3 Random Forests and Bagging5.4 Support Vector MachinesTypes of Support Vector MachinesWorking PrincipleSteps to Perform SVMscikit-learn (sklearn)numpy (np)matplotlib.pyplot (plt)5.4.1 Linear SVM5.4.2 Kernel SVM5.4.3 Hyperparameter Tuning in SVM5.5 K-Means Clustering5.5.1 Clustering Basics5.5.2 Selecting the Number of Clusters5.6 Principal Component AnalysisMathematical Concepts Employed in PCAEigendecompositionSelecting Principal ComponentsProjectionMathematical Representation5.6.1 Dimensionality Reduction5.6.2 Eigenvectors and Eigenvalues5.7 Naive BayesBayes’ TheoremApplications5.7.1 Gaussian Naive Bayes5.7.2 Multinomial Naive Bayes5.8 Ensemble Methods: Boosting, Bagging5.8.1 Bagging and Boosting Overview5.8.2 AdaBoost and Gradient BoostingSummaryExercise (MCQs)AnswersFill in the BlanksAnswersDescriptive Questions