July 2018
Beginner to intermediate
376 pages
9h 1m
English
In Chapter 1, Introduction to Ensemble Techniques, we became familiar with a variety of classification models. Some readers might already be familiar with the k-NN model. The k-NN classifier is one of the most simple, intuitive, and non-assumptive models. The name of the model itself suggests how it might be working - nearest neighborhoods! And that's preceded by k! Thus, if we have N points in a study, we find the k-nearest points in neighborhood, and then make a note of the class of the k-neighbors. The majority class of the k-neighbors is then assigned to the unit. In case of regression, the average of the neighbors is assigned to the unit. The following is a visual depiction of k-NN:
Figure 4: Visual depiction of k-NN
The top ...