book

The Supervised Learning Workshop - Second Edition

Name: The Supervised Learning Workshop - Second Edition
ISBN: 9781800209046

by Blaine Bateman, Ashish Ranjan Jha, Benjamin Johnston, Ishita Mathur, Tiffany Ford, Sukanya Mandal, Ashish Pratik Patil

February 2020

Beginner to intermediate

532 pages

9h 36m

English

Packt Publishing

Read now

Unlock full access

The Supervised Learning Workshop
Second Edition
Preface
About the BookAudienceAbout the ChaptersConventionsCode PresentationSetting up Your EnvironmentInstallation and SetupInstalling Anaconda on Windows Installing Anaconda on macOSInstalling Anaconda on LinuxInstalling LibrariesAccessing the Code Files
1. Fundamentals
IntroductionWhen to Use Supervised LearningPython Packages and ModulesLoading Data in PandasExercise 1.01: Loading and Summarizing the Titanic DatasetExercise 1.02: Indexing and Selecting DataExercise 1.03: Advanced Indexing and SelectionPandas MethodsExercise 1.04: Using the Aggregate MethodQuantilesLambda FunctionsExercise 1.05: Creating Lambda FunctionsData Quality ConsiderationsManaging Missing DataClass ImbalanceLow Sample SizeActivity 1.01: Implementing Pandas FunctionsSummary
2. Exploratory Data Analysis and Visualization
IntroductionExploratory Data Analysis (EDA)Summary Statistics and Central ValuesExercise 2.01: Summarizing the Statistics of Our DatasetMissing ValuesFinding Missing ValuesExercise 2.02: Visualizing Missing ValuesImputation Strategies for Missing ValuesExercise 2.03: Performing Imputation Using PandasExercise 2.04: Performing Imputation Using Scikit-LearnExercise 2.05: Performing Imputation Using Inferred ValuesActivity 2.01: Summary Statistics and Missing ValuesDistribution of ValuesTarget VariableExercise 2.06: Plotting a Bar ChartCategorical DataExercise 2.07: Identifying Data Types for Categorical VariablesExercise 2.08: Calculating Category Value CountsExercise 2.09: Plotting a Pie ChartContinuous DataSkewnessKurtosisExercise 2.10: Plotting a HistogramExercise 2.11: Computing Skew and KurtosisActivity 2.02: Representing the Distribution of Values VisuallyRelationships within the DataRelationship between Two Continuous VariablesPearson's Coefficient of CorrelationExercise 2.12: Plotting a Scatter PlotExercise 2.13: Plotting a Correlation HeatmapUsing PairplotsExercise 2.14: Implementing a PairplotRelationship between a Continuous and a Categorical VariableExercise 2.15: Plotting a Bar ChartExercise 2.16: Visualizing a Box PlotRelationship Between Two Categorical VariablesExercise 2.17: Plotting a Stacked Bar ChartActivity 2.03: Relationships within the DataSummary
3. Linear Regression
IntroductionRegression and Classification ProblemsThe Machine Learning WorkflowBusiness UnderstandingData UnderstandingData PreparationModelingEvaluationDeploymentExercise 3.01: Plotting Data with a Moving AverageActivity 3.01: Plotting Data with a Moving AverageLinear RegressionLeast Squares MethodThe Scikit-Learn Model APIExercise 3.02: Fitting a Linear Model Using the Least Squares MethodActivity 3.02: Linear Regression Using the Least Squares MethodLinear Regression with Categorical VariablesExercise 3.03: Introducing Dummy VariablesActivity 3.03: Dummy VariablesPolynomial Models with Linear RegressionExercise 3.04: Polynomial Models with Linear RegressionActivity 3.04: Feature Engineering with Linear RegressionGeneric Model TrainingGradient DescentExercise 3.05: Linear Regression with Gradient DescentExercise 3.06: Optimizing Gradient DescentActivity 3.05: Gradient DescentMultiple Linear RegressionExercise 3.07: Multiple Linear RegressionSummary
4. Autoregression
IntroductionAutoregression ModelsExercise 4.01: Creating an Autoregression ModelActivity 4.01: Autoregression Model Based on Periodic DataSummary
5. Classification Techniques
IntroductionOrdinary Least Squares as a ClassifierExercise 5.01: Ordinary Least Squares as a ClassifierLogistic RegressionExercise 5.02: Logistic Regression as a Classifier – Binary ClassifierExercise 5.03: Logistic Regression – Multiclass ClassifierActivity 5.01: Ordinary Least Squares Classifier – Binary ClassifierSelect K Best Feature SelectionExercise 5.04: Breast Cancer Diagnosis Classification Using Logistic RegressionClassification Using K-Nearest NeighborsExercise 5.05: KNN ClassificationExercise 5.06: Visualizing KNN BoundariesActivity 5.02: KNN Multiclass ClassifierClassification Using Decision TreesExercise 5.07: ID3 ClassificationClassification and Regression TreeExercise 5.08: Breast Cancer Diagnosis Classification Using a CART Decision TreeActivity 5.03: Binary Classification Using a CART Decision TreeArtificial Neural NetworksExercise 5.09: Neural Networks – Multiclass ClassifierActivity 5.04: Breast Cancer Diagnosis Classification Using Artificial Neural NetworksSummary
6. Ensemble Modeling
IntroductionOne-Hot EncodingExercise 6.01: Importing Modules and Preparing the DatasetOverfitting and UnderfittingUnderfittingOverfittingOvercoming the Problem of Underfitting and OverfittingBaggingBootstrappingExercise 6.02: Using the Bagging ClassifierRandom ForestExercise 6.03: Building the Ensemble Model Using Random ForestBoostingAdaptive BoostingExercise 6.04: Implementing Adaptive BoostingGradient BoostingExercise 6.05: Implementing GradientBoostingClassifier to Build an Ensemble ModelStackingExercise 6.06: Building a Stacked ModelActivity 6.01: Stacking with Standalone and Ensemble AlgorithmsSummary
7. Model Evaluation
IntroductionImporting the Modules and Preparing Our DatasetEvaluation MetricsRegression MetricsExercise 7.01: Calculating Regression MetricsClassification MetricsNumerical MetricsCurve PlotsExercise 7.02: Calculating Classification MetricsSplitting a DatasetHold-Out DataK-Fold Cross-ValidationSamplingExercise 7.03: Performing K-Fold Cross-Validation with Stratified SamplingPerformance Improvement TacticsVariation in Train and Test ErrorsLearning CurveValidation CurveHyperparameter TuningExercise 7.04: Hyperparameter Tuning with Random SearchFeature ImportanceExercise 7.05: Feature Importance Using Random ForestActivity 7.01: Final Test ProjectSummary
Appendix
1. FundamentalsActivity 1.01: Implementing Pandas Functions2. Exploratory Data Analysis and VisualizationActivity 2.01: Summary Statistics and Missing ValuesActivity 2.02: Representing the Distribution of Values VisuallyActivity 2.03: Relationships within the Data3. Linear RegressionActivity 3.01: Plotting Data with a Moving AverageActivity 3.02: Linear Regression Using the Least Squares MethodActivity 3.03: Dummy VariablesActivity 3.04: Feature Engineering with Linear RegressionActivity 3.05: Gradient Descent4. AutoregressionActivity 4.01: Autoregression Model Based on Periodic Data5. Classification TechniquesActivity 5.01: Ordinary Least Squares Classifier – Binary ClassifierActivity 5.02: KNN Multiclass ClassifierActivity 5.03: Binary Classification Using a CART Decision TreeActivity 5.04: Breast Cancer Diagnosis Classification Using Artificial Neural Networks6. Ensemble ModelingActivity 6.01: Stacking with Standalone and Ensemble Algorithms7. Model EvaluationActivity 7.01: Final Test Project

Content preview from The Supervised Learning Workshop - Second Edition

6. Ensemble Modeling

Overview

This chapter examines different ways of performing ensemble modeling, along with its benefits and limitations. By the end of the chapter, you will be able to recognize the underfitting and overfitting of data on machine learning models. You will also be able to devise a bagging classifier using decision trees and implement adaptive boosting and gradient boosting models. Finally, you will be able to build a stacked ensemble using a number of classifiers.

Introduction

In the previous chapters, we discussed the two types of supervised learning problems: regression and classification. We looked at a number of algorithms for each type and delved into how those algorithms worked.

But there are times when these algorithms, ...

Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.

Read now

Unlock full access

More than 5,000 organizations count on O’Reilly

O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.

Julian F.

Head of Cybersecurity

I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.

Addison B.

Field Engineer

I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.

Amir M.

Data Platform Tech Lead

I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.

Mark W.

Embedded Software Engineer

Publisher Resources

ISBN: 9781800209046

Cloud Computing

Data Engineering

Data Science

AI & ML

Programming Languages

Software Architecture

IT/Ops

Security

Design

Business

Soft Skills

The Supervised Learning Workshop - Second Edition

by Blaine Bateman, Ashish Ranjan Jha, Benjamin Johnston, Ishita Mathur, Tiffany Ford, Sukanya Mandal, Ashish Pratik Patil

6. Ensemble Modeling

Introduction

Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.