book

Applied Supervised Learning with Python

Name: Applied Supervised Learning with Python
ISBN: 9781789954920

by Benjamin Johnston, Ishita Mathur

April 2019

Intermediate to advanced

404 pages

7h 25m

English

Packt Publishing

Read now

Unlock full access

Preface
About the BookAbout the AuthorsObjectivesAudienceApproachHardware RequirementsSoftware RequirementsConventionsInstallation and SetupInstalling the Code BundleAdditional Resources
Chapter 1
Python Machine Learning ToolkitIntroductionSupervised Machine LearningWhen to Use Supervised LearningWhy Python?Jupyter NotebooksExercise 1: Launching a Jupyter NotebookExercise 2: Hello WorldExercise 3: Order of Execution in a Jupyter NotebookExercise 4: Advantages of Jupyter NotebooksPython Packages and ModulespandasLoading Data in pandasExercise 5: Loading and Summarizing the Titanic DatasetExercise 6: Indexing and Selecting DataExercise 7: Advanced Indexing and Selectionpandas MethodsExercise 8: Splitting, Applying, and Combining Data SourcesLambda FunctionsExercise 9: Lambda FunctionsData Quality ConsiderationsManaging Missing DataClass ImbalanceLow Sample SizeActivity 1: pandas FunctionsSummary
Chapter 2
Exploratory Data Analysis and VisualizationIntroductionExploratory Data Analysis (EDA)Exercise 10: Importing Libraries for Data ExplorationSummary Statistics and Central ValuesStandard DeviationPercentilesExercise 11: Summary Statistics of Our DatasetMissing ValuesFinding Missing ValuesExercise 12: Visualizing Missing ValuesImputation Strategies for Missing ValuesExercise 13: Imputation Using pandasExercise 14: Imputation Using scikit-learnExercise 15: Imputation Using Inferred ValuesActivity 2: Summary Statistics and Missing ValuesDistribution of ValuesTarget VariableExercise 16: Plotting a Bar ChartCategorical DataExercise 17: Datatypes for Categorical VariablesExercise 18: Calculating Category Value CountsExercise 19: Plotting a Pie ChartContinuous DataExercise 20: Plotting a HistogramExercise 21: Skew and KurtosisActivity 3: Visually Representing the Distribution of ValuesRelationships within the DataRelationship between Two Continuous VariablesExercise 22: Plotting a Scatter PlotExercise 23: Correlation HeatmapExercise 24: PairplotRelationship between a Continuous and a Categorical VariableExercise 25: Bar ChartExercise 26: Box PlotRelationship between Two Categorical VariablesExercise 27: Stacked Bar ChartActivity 4: Relationships Within the DataSummary
Chapter 3
Regression AnalysisIntroductionRegression and Classification ProblemsData, Models, Training, and EvaluationLinear RegressionExercise 28: Plotting Data with a Moving AverageActivity 5: Plotting Data with a Moving AverageLeast Squares MethodThe scikit-learn Model APIExercise 29: Fitting a Linear Model Using the Least Squares MethodActivity 6: Linear Regression Using the Least Squares MethodLinear Regression with Dummy VariablesExercise 30: Introducing Dummy VariablesActivity 7: Dummy VariablesParabolic Model with Linear RegressionExercise 31: Parabolic Models with Linear RegressionActivity 8: Other Model Types with Linear RegressionGeneric Model TrainingGradient DescentExercise 32: Linear Regression with Gradient DescentExercise 33: Optimizing Gradient DescentActivity 9: Gradient DescentMultiple Linear RegressionExercise 34: Multiple Linear RegressionAutoregression ModelsExercise 35: Creating an Autoregression ModelActivity 10: AutoregressorsSummary
Chapter 4
ClassificationIntroductionLinear Regression as a ClassifierExercise 36: Linear Regression as a ClassifierLogistic RegressionExercise 37: Logistic Regression as a Classifier – Two-Class ClassifierExercise 38: Logistic Regression – Multiclass ClassifierActivity 11: Linear Regression Classifier – Two-Class ClassifierActivity 12: Iris Classification Using Logistic RegressionClassification Using K-Nearest NeighborsExercise 39: K-NN ClassificationExercise 40: Visualizing K-NN BoundariesActivity 13: K-NN Multiclass ClassifierClassification Using Decision TreesExercise 41: ID3 ClassificationExercise 42: Iris Classification Using a CART Decision TreeSummary
Chapter 5
Ensemble ModelingIntroductionExercise 43: Importing Modules and Preparing the DatasetOverfitting and UnderfittingUnderfittingOverfittingOvercoming the Problem of Underfitting and OverfittingBaggingBootstrappingBootstrap AggregationExercise 44: Using the Bagging ClassifierRandom ForestExercise 45: Building the Ensemble Model Using Random ForestBoostingAdaptive BoostingExercise 46: Adaptive BoostingGradient BoostingExercise 47: GradientBoostingClassifierStackingExercise 48: Building a Stacked ModelActivity 14: Stacking with Standalone and Ensemble AlgorithmsSummary
Chapter 6
Model EvaluationIntroductionExercise 49: Importing the Modules and Preparing Our DatasetEvaluation MetricsRegressionExercise 50: Regression MetricsClassificationExercise 51: Classification MetricsSplitting the DatasetHold-out DataK-Fold Cross-ValidationSamplingExercise 52: K-Fold Cross-Validation with Stratified SamplingPerformance Improvement TacticsVariation in Train and Test ErrorHyperparameter TuningExercise 53: Hyperparameter Tuning with Random SearchFeature ImportanceExercise 54: Feature Importance Using Random ForestActivity 15: Final Test ProjectSummary
Appendix
Chapter 1: Python Machine Learning ToolkitActivity 1: pandas FunctionsChapter 2: Exploratory Data Analysis and VisualizationActivity 2: Summary Statistics and Missing ValuesActivity 3: Visually Representing the Distribution of ValuesActivity 4: Relationships Within the DataChapter 3: Regression AnalysisActivity 5: Plotting Data with a Moving AverageActivity 6: Linear Regression Using the Least Squares MethodActivity 7: Dummy VariablesActivity 8: Other Model Types with Linear RegressionActivity 9: Gradient DescentActivity 10: AutoregressorsChapter 4: ClassificationActivity 11: Linear Regression Classifier – Two-Class ClassifierActivity 12: Iris Classification Using Logistic RegressionActivity 13: K-NN Multiclass ClassifierChapter 5: Ensemble ModelingActivity 14: Stacking with Standalone and Ensemble AlgorithmsChapter 6: Model EvaluationActivity 15: Final Test Project

Content preview from Applied Supervised Learning with Python

Chapter 3 Regression Analysis

Learning Objectives

By the end of this chapter, you will be able to:

Describe regression models and explain the difference between regression and classification problems
Explain the concept of gradient descent, how it is used in linear regression problems, and how it can be applied to other model architectures
Use linear regression to construct a linear model for data in an x-y plane
Evaluate the performance of linear models and use the evaluation to choose the best model
Use feature engineering to create dummy variables for constructing more complicated linear models
Construct time series regression models using autoregression

This chapter covers regression problems and analysis, introducing us to linear ...

Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.

Read now

Unlock full access

More than 5,000 organizations count on O’Reilly

O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.

Julian F.

Head of Cybersecurity

I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.

Addison B.

Field Engineer

I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.

Amir M.

Data Platform Tech Lead

I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.

Mark W.

Embedded Software Engineer

Applied Unsupervised Learning with Python

Publisher Resources

ISBN: 9781789954920

Cloud Computing

Data Engineering

Data Science

AI & ML

Programming Languages

Software Architecture

IT/Ops

Security

Design

Business

Soft Skills

Applied Supervised Learning with Python

by Benjamin Johnston, Ishita Mathur

Chapter 3

Regression Analysis

Learning Objectives

Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.