Hands-On Ensemble Learning with Python

Soft voting

Soft voting takes into account the probability of the predicted classes. In order to combine the predictions, soft voting calculates the average probability of each class and assumes that the winner is the class with the highest average probability.In the simple case of three base learners and two classes, we must take into consideration the predicted probability for each class and average them across the three learners:

Soft voting with two classes and three base learners

Using our previous example, and by taking the average of each column for Table 1, we can expand it, adding a row for the average probability.

The following table ...