Machine Learning with scikit-learn Quick Start Guide

The random forests classifier

Now that you understand the core principles of the decision tree at a very foundational level, we will next explore what random forests are. Random forests are a form of ensemble learning. An ensemble learning method is one that makes use of multiple machine learning models to make a decision.

Let's consider the following diagram:

The concept of ensemble learning

The random forest algorithm operates as follows:

1. Assume that you initially have a dataset with 100 features.
2. From this, we will build a decision tree with 10 features initially. The features are selected randomly.
3. Now, using a random selection of the ...