book

Grokking Machine Learning

Name: Grokking Machine Learning
Author: Luis Serrano
ISBN: 9781617295911

by Luis Serrano

December 2021

Intermediate to advanced

512 pages

15h 23m

English

Manning Publications

Read now

Unlock full access

Grokking Machine Learning
inside front cover
Copyright
contents
front matter
forewordprefaceacknowledgmentsabout this bookTypes of chaptersRecommended learning pathsAppendicesRequirements and learning goalsOther resourcesWe’ll be writing codeabout the author
1 What is machine learning? It is common sense, except done by a computer
Do I need a heavy math and coding background to understand machine learning?OK, so what exactly is machine learning?How do we get machines to make decisions with data? The remember-formulate-predict frameworkSummary
2 Types of machine learning
What is the difference between labeled and unlabeled data?Supervised learning: The branch of machine learning that works with labeled dataUnsupervised learning: The branch of machine learning that works with unlabeled dataWhat is reinforcement learning?SummaryExercises
3 Drawing a line close to our points: Linear regression
The problem: We need to predict the price of a houseThe solution: Building a regression model for housing pricesHow to get the computer to draw this line: The linear regression algorithmHow do we measure our results? The error functionReal-life application: Using Turi Create to predict housing prices in IndiaWhat if the data is not in a line? Polynomial regressionParameters and hyperparametersApplications of regressionSummaryExercises
4 Optimizing the training process: Underfitting, overfitting, testing, and regularization
An example of underfitting and overfitting using polynomial regressionHow do we get the computer to pick the right model? By testingWhere did we break the golden rule, and how do we fix it? The validation setA numerical way to decide how complex our model should be: The model complexity graphAnother alternative to avoiding overfitting: RegularizationPolynomial regression, testing, and regularization with Turi CreateSummaryExercises
5 Using lines to split our points: The perceptron algorithm
The problem: We are on an alien planet, and we don’t know their language!How do we determine whether a classifier is good or bad? The error functionHow to find a good classifier? The perceptron algorithmCoding the perceptron algorithmApplications of the perceptron algorithmSummaryExercises

6 A continuous approach to splitting points: Logistic classifiers
Logistic classifiers: A continuous version of perceptron classifiersHow to find a good logistic classifier? The logistic regression algorithmCoding the logistic regression algorithmReal-life application: Classifying IMDB reviews with Turi CreateClassifying into multiple classes: The softmax functionSummaryExercises
7 How do you measure classification models? Accuracy and its friends
Accuracy: How often is my model correct?How to fix the accuracy problem? Defining different types of errors and how to measure themA useful tool to evaluate our model: The receiver operating characteristic (ROC) curveSummaryExercises
8 Using probability to its maximum: The naive Bayes model
Sick or healthy? A story with Bayes’ theorem as the heroUse case: Spam-detection modelBuilding a spam-detection model with real dataSummaryExercises
9 Splitting data by asking questions: Decision trees
The problem: We need to recommend apps to users according to what they are likely to downloadThe solution: Building an app-recommendation systemBeyond questions like yes/noThe graphical boundary of decision treesReal-life application: Modeling student admissions with Scikit-LearnDecision trees for regressionApplicationsSummaryExercises
10 Combining building blocks to gain more power: Neural networks
Neural networks with an example: A more complicated alien planetTraining neural networksCoding neural networks in KerasNeural networks for regressionOther architectures for more complex datasetsSummaryExercises
11 Finding boundaries with style: Support vector machines and the kernel method
Using a new error function to build better classifiersCoding support vector machines in Scikit-LearnTraining SVMs with nonlinear boundaries: The kernel methodSummaryExercises
12 Combining models to maximize results: Ensemble learning
With a little help from our friendsBagging: Joining some weak learners randomly to build a strong learnerAdaBoost: Joining weak learners in a clever way to build a strong learnerGradient boosting: Using decision trees to build strong learnersXGBoost: An extreme way to do gradient boostingApplications of ensemble methodsSummaryExercises
13 Putting it all in practice: A real-life example of data engineering and machine learning
The Titanic datasetCleaning up our dataset: Missing values and how to deal with themFeature engineering: Transforming the features in our dataset before training the modelsTraining our modelsTuning the hyperparameters to find the best model: Grid searchUsing K-fold cross-validation to reuse our data as training and validationSummaryExercises
Appendix A. Solutions to the exercises
Chapter 2: Types of machine learningChapter 3: Drawing a line close to our points: Linear regressionChapter 4: Optimizing the training process: Underfitting, overfitting, testing, and regularizationChapter 5: Using lines to split our points: The perceptron algorithmChapter 6: A continuous approach to splitting points: Logistic classifiersChapter 7: How do you measure classification models? Accuracy and its friendsChapter 8: Using probability to its maximum: The naive Bayes modelChapter 9: Splitting data by asking questions: Decision treesChapter 10: Combining building blocks to gain more power: Neural networksChapter 11: Finding boundaries with style: Support vector machines and the kernel methodChapter 12: Combining models to maximize results: Ensemble learningChapter 13: Putting it all in practice: A real-life example of data engineering and machine learning
Appendix B. The math behind gradient descent: Coming down a mountain using derivatives and slopes
Using gradient descent to decrease functionsUsing gradient descent to train modelsUsing gradient descent for regularizationGetting stuck on local minima: How it happens, and how we solve it
Appendix C. References
General referencesCoursesBlogs and YouTube channelsBooksChapter 1Chapter 2Chapter 3Chapter 4Chapter 5Chapter 6Chapter 7Chapter 8Chapter 9Chapter 10Chapter 11Chapter 12Chapter 13Graphics and image icons
index

Content preview from Grokking Machine Learning

4 Optimizing the training process: Underfitting, overfitting, testing, and regularization

In this chapter

what is underfitting and overfitting
some solutions for avoiding overfitting: testing, the model complexity graph, and regularization
calculating the complexity of the model using the L1 and L2 norms
picking the best model in terms of performance and complexity

This chapter is different from most of the chapters in this book, because it doesn’t contain a particular machine learning algorithm. Instead, it describes some potential problems that machine learning models may face and effective practical ways to solve them.

Imagine that you have ...

Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.

Read now

Unlock full access

More than 5,000 organizations count on O’Reilly

O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.

Julian F.

Head of Cybersecurity

I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.

Addison B.

Field Engineer

I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.

Amir M.

Data Platform Tech Lead

I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.

Mark W.

Embedded Software Engineer

Machine Learning with PyTorch and Scikit-Learn

Publisher Resources

ISBN: 9781617295911Publisher Support Publisher Website Errata Page

Cloud Computing

Data Engineering

Data Science

AI & ML

Programming Languages

Software Architecture

IT/Ops

Security

Design

Business

Soft Skills

Grokking Machine Learning

by Luis Serrano

4 Optimizing the training process: Underfitting, overfitting, testing, and regularization

Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.