Skip to Main Content
Hands-On Predictive Analytics with Python
book

Hands-On Predictive Analytics with Python

by Alvaro Fuentes
December 2018
Beginner to intermediate content levelBeginner to intermediate
330 pages
8h 32m
English
Packt Publishing
Content preview from Hands-On Predictive Analytics with Python

Optimizing a single hyperparameter

k-nearest neighbors (KNN) is an example of a non-parametric model, meaning it has no parameters to be learned from data; however, it has one very important hyperparameter—the number of neighbors. Back in Chapter 4, Predicting Numerical Values with Machine Learning, we used a KNN model with 12 neighbors in our diamond prices dataset, and that model gave us the best result when compared with multiple linear regression and lasso. We used 12 because I thought it was a good value, however, there is no guarantee it is the best value; why not nine or 15 neighbors? Maybe 10 works best. That is what the activity of hyperparameter optimization is all about—finding the set of best hyperparameters, or, more often, a ...

Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.
Start your free trial

You might also like

Python: Advanced Predictive Analytics

Python: Advanced Predictive Analytics

Ashish Kumar, Joseph Babcock
Python: Data Analytics and Visualization

Python: Data Analytics and Visualization

Phuong Vo.T.H, Martin Czygan, Ashish Kumar, Kirthi Raman
Python: End-to-end Data Analysis

Python: End-to-end Data Analysis

Phuong Vothihong, Martin Czygan, Ivan Idris, Magnus Vilhelm Persson, Luiz Felipe Martins

Publisher Resources

ISBN: 9781789138719Supplemental Content