The classifiers whose decisions are combined to form the ensemble are called “base classifiers.” This chapter details some of the most popular base classifier models.
Linear and quadratic classifiers are named after the type of discriminant functions they use. Let be the object to classify in one of c classes. Let be a vector with coefficients and wi0 be a constant free term. A linear classifier is any set of c linear functions, one for each class, , i = 1, …, c,
The tag of the largest gi(x) determines the class label.
A straightforward way to train a linear discriminant classifier (LDC) is shown in Figure 2.2 and detailed below: