Machine Learning with scikit-learn Quick Start Guide

The decision tree classifier

The decision tree is the simplest tree based algorithm, and serves as the foundation for the other two algorithms. Let's consider the following simple decision tree:

A simple decision tree

A decision tree, in simple terms, is a set of rules that help us classify observations into distinct groups. In the previous diagram, the rule could be written as the following:

If (value of feature is less than 50); then (put the triangles in the left-hand box and put the circles in the right-hand box).

The preceding decision tree perfectly divides the observations into two distinct groups. This is a characteristic of the ideal ...