book

Machine Learning with R - Third Edition

Name: Machine Learning with R - Third Edition
Author: Brett Lantz
ISBN: 9781788295864

by Brett Lantz

April 2019

Intermediate to advanced

458 pages

12h 35m

English

Packt Publishing

Read now

Unlock full access

Machine Learning with R - Third Edition
Table of Contents
Machine Learning with R - Third Edition
Why subscribe?
Packt.com
Contributors
About the authors
About the reviewer
Preface
Who this book is for
What this book covers
What you need for this book
Download the example code filesDownload the color imagesConventions used
Get in touch
Reviews

1. Introducing Machine Learning
The origins of machine learning
Uses and abuses of machine learning
Machine learning successesThe limits of machine learningMachine learning ethics
How machines learn
Data storageAbstractionGeneralizationEvaluation
Machine learning in practice
Types of input dataTypes of machine learning algorithmsMatching input data to algorithms
Machine learning with R
Installing R packagesLoading and unloading R packagesInstalling RStudio
Summary
2. Managing and Understanding Data
R data structuresVectorsFactorsListsData framesMatrices and arrays
Managing data with R
Saving, loading, and removing R data structuresImporting and saving data from CSV files
Exploring and understanding data
Exploring the structure of dataExploring numeric variablesMeasuring the central tendency – mean and medianMeasuring spread – quartiles and the five-number summaryVisualizing numeric variables – boxplotsVisualizing numeric variables – histogramsUnderstanding numeric data – uniform and normal distributionsMeasuring spread – variance and standard deviationExploring categorical variablesMeasuring the central tendency – the modeExploring relationships between variablesVisualizing relationships – scatterplotsExamining relationships – two-way cross-tabulations
Summary
3. Lazy Learning – Classification Using Nearest Neighbors
Understanding nearest neighbor classificationThe k-NN algorithmMeasuring similarity with distanceChoosing an appropriate kPreparing data for use with k-NNWhy is the k-NN algorithm lazy?
Example – diagnosing breast cancer with the k-NN algorithm
Step 1 – collecting dataStep 2 – exploring and preparing the dataTransformation – normalizing numeric dataData preparation – creating training and test datasetsStep 3 – training a model on the dataStep 4 – evaluating model performanceStep 5 – improving model performanceTransformation – z-score standardizationTesting alternative values of k
Summary
4. Probabilistic Learning – Classification Using Naive Bayes
Understanding Naive BayesBasic concepts of Bayesian methodsUnderstanding probabilityUnderstanding joint probabilityComputing conditional probability with Bayes' theoremThe Naive Bayes algorithmClassification with Naive BayesThe Laplace estimatorUsing numeric features with Naive Bayes
Example – filtering mobile phone spam with the Naive Bayes algorithm
Step 1 – collecting dataStep 2 – exploring and preparing the dataData preparation – cleaning and standardizing text dataData preparation – splitting text documents into wordsData preparation – creating training and test datasetsVisualizing text data – word cloudsData preparation – creating indicator features for frequent wordsStep 3 – training a model on the dataStep 4 – evaluating model performanceStep 5 – improving model performance
Summary
5. Divide and Conquer – Classification Using Decision Trees and Rules
Understanding decision treesDivide and conquerThe C5.0 decision tree algorithmChoosing the best splitPruning the decision tree
Example – identifying risky bank loans using C5.0 decision trees
Step 1 – collecting dataStep 2 – exploring and preparing the dataData preparation – creating random training and test datasetsStep 3 – training a model on the dataStep 4 – evaluating model performanceStep 5 – improving model performanceBoosting the accuracy of decision treesMaking some mistakes cost more than others
Understanding classification rules
Separate and conquerThe 1R algorithmThe RIPPER algorithmRules from decision treesWhat makes trees and rules greedy?
Example – identifying poisonous mushrooms with rule learners
Step 1 – collecting dataStep 2 – exploring and preparing the dataStep 3 – training a model on the dataStep 4 – evaluating model performanceStep 5 – improving model performance
Summary
6. Forecasting Numeric Data – Regression Methods
Understanding regressionSimple linear regressionOrdinary least squares estimationCorrelationsMultiple linear regression
Example – predicting medical expenses using linear regression
Step 1 – collecting dataStep 2 – exploring and preparing the dataExploring relationships among features – the correlation matrixVisualizing relationships among features – the scatterplot matrixStep 3 – training a model on the dataStep 4 – evaluating model performanceStep 5 – improving model performanceModel specification – adding nonlinear relationshipsTransformation – converting a numeric variable to a binary indicatorModel specification – adding interaction effectsPutting it all together – an improved regression modelMaking predictions with a regression model
Understanding regression trees and model trees
Adding regression to trees
Example – estimating the quality of wines with regression trees and model trees
Step 1 – collecting dataStep 2 – exploring and preparing the dataStep 3 – training a model on the dataVisualizing decision treesStep 4 – evaluating model performanceMeasuring performance with the mean absolute errorStep 5 – improving model performance
Summary
7. Black Box Methods – Neural Networks and Support Vector Machines
Understanding neural networksFrom biological to artificial neuronsActivation functionsNetwork topologyThe number of layersThe direction of information travelThe number of nodes in each layerTraining neural networks with backpropagation
Example – modeling the strength of concrete with ANNs
Step 1 – collecting dataStep 2 – exploring and preparing the dataStep 3 – training a model on the dataStep 4 – evaluating model performanceStep 5 – improving model performance
Understanding support vector machines
Classification with hyperplanesThe case of linearly separable dataThe case of nonlinearly separable dataUsing kernels for nonlinear spaces
Example – performing OCR with SVMs
Step 1 – collecting dataStep 2 – exploring and preparing the dataStep 3 – training a model on the dataStep 4 – evaluating model performanceStep 5 – improving model performanceChanging the SVM kernel functionIdentifying the best SVM cost parameter
Summary
8. Finding Patterns – Market Basket Analysis Using Association Rules
Understanding association rulesThe Apriori algorithm for association rule learningMeasuring rule interest – support and confidenceBuilding a set of rules with the Apriori principle
Example – identifying frequently purchased groceries with association rules
Step 1 – collecting dataStep 2 – exploring and preparing the dataData preparation – creating a sparse matrix for transaction dataVisualizing item support – item frequency plotsVisualizing the transaction data – plotting the sparse matrixStep 3 – training a model on the dataStep 4 – evaluating model performanceStep 5 – improving model performanceSorting the set of association rulesTaking subsets of association rulesSaving association rules to a file or data frame
Summary
9. Finding Groups of Data – Clustering with k-means
Understanding clusteringClustering as a machine learning taskThe k-means clustering algorithmUsing distance to assign and update clustersChoosing the appropriate number of clusters
Finding teen market segments using k-means clustering
Step 1 – collecting dataStep 2 – exploring and preparing the dataData preparation – dummy coding missing valuesData preparation – imputing the missing valuesStep 3 – training a model on the dataStep 4 – evaluating model performanceStep 5 – improving model performance
Summary
10. Evaluating Model Performance
Measuring performance for classificationUnderstanding a classifier's predictionsA closer look at confusion matricesUsing confusion matrices to measure performanceBeyond accuracy – other measures of performanceThe kappa statisticSensitivity and specificityPrecision and recallThe F-measureVisualizing performance tradeoffs with ROC curves
Estimating future performance
The holdout methodCross-validationBootstrap sampling
Summary
11. Improving Model Performance
Tuning stock models for better performanceUsing caret for automated parameter tuningCreating a simple tuned modelCustomizing the tuning process
Improving model performance with meta-learning
Understanding ensemblesBaggingBoostingRandom forestsTraining random forestsEvaluating random forest performance in a simulated competition
Summary
12. Specialized Machine Learning Topics
Managing and preparing real-world dataMaking data "tidy" with the tidyverse packagesGeneralizing tabular data structures with tibbleSpeeding and simplifying data preparation with dplyrReading and writing to external data filesImporting tidy tables with readrImporting Microsoft Excel, SAS, SPSS, and Stata files with rioQuerying data in SQL databasesThe tidy approach to managing database connectionsUsing a database backend with dplyrA traditional approach to SQL connectivity with RODBC
Working with online data and services
Downloading the complete text of web pagesParsing the data within web pagesParsing XML documentsParsing JSON from web APIs
Working with domain-specific data
Analyzing bioinformatics dataAnalyzing and visualizing network data
Improving the performance of R
Managing very large datasetsMaking data frames faster with data.tableCreating disk-based data frames with ffUsing massive matrices with bigmemoryLearning faster with parallel computingMeasuring execution timeWorking in parallel with multicore and snowTaking advantage of parallel with foreach and doParallelTraining and evaluating models in parallel with caretParallel cloud computing with MapReduce and HadoopParallel cloud computing with Apache SparkDeploying optimized learning algorithmsBuilding bigger regression models with biglmGrowing random forests faster with rangerGrowing massive random forests with bigrfA faster machine learning computing engine with H2OGPU computingFlexible numeric computing and machine learning with TensorFlowAn interface for deep learning with Keras
Summary
Other Books You May Enjoy
Leave a review - let other readers know what you think
Index

Content preview from Machine Learning with R - Third Edition

Summary

This chapter covered two classification methods that use so-called "greedy" algorithms to partition the data according to feature values. Decision trees use a divide and conquer strategy to create flowchart-like structures, while rule learners separate and conquer data to identify logical if-else rules. Both methods produce models that can be interpreted without a statistical background.

One popular and highly configurable decision tree algorithm is C5.0. We used the C5.0 algorithm to create a tree to predict whether a loan applicant will default. Using options for boosting and cost-sensitive errors, we were able to improve our accuracy and avoid risky loans that could cost the bank more money.

We also used two rule learners, 1R and RIPPER, ...

Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.

Read now

Unlock full access

More than 5,000 organizations count on O’Reilly

O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.

Julian F.

Head of Cybersecurity

I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.

Addison B.

Field Engineer

I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.

Amir M.

Data Platform Tech Lead

I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.

Mark W.

Embedded Software Engineer

Mastering Machine Learning with R - Third Edition

Publisher Resources

ISBN: 9781788295864

Cloud Computing

Data Engineering

Data Science

AI & ML

Programming Languages

Software Architecture

IT/Ops

Security

Design

Business

Soft Skills

Machine Learning with R - Third Edition

by Brett Lantz

Summary

Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.