Constructing a k-nearest neighbors classifier

The k-nearest neighbors is an algorithm that uses k-nearest neighbors in the training dataset to find the category of an unknown object. When we want to find the class to which an unknown point belongs to, we find the k-nearest neighbors and take a majority vote. Let's take a look at how to construct this.

How to do it…

  1. Create a new Python file, and import the following packages:
    import numpy as np
    import matplotlib.pyplot as plt
    import matplotlib.cm as cm
    from sklearn import neighbors, datasets
    
    from utilities import load_data
  2. We will use the data_nn_classifier.txt file for input data. Let's load this input data:
    # Load input data input_file = 'data_nn_classifier.txt' data = load_data(input_file) X, y = ...

Get Python: Real World Machine Learning now with O’Reilly online learning.

O’Reilly members experience live online training, plus books, videos, and digital content from 200+ publishers.