2.2. Bayes Decision Theory
We will initially focus on the two-class case. Let ω1, ω2 be the two classes in which our patterns belong. In the sequel, we assume that the a priori probabilities P(ω1), P(ω2) are known. This is a very reasonable assumption, because even if they are not known, they can easily be estimated from the available training feature vectors. Indeed, if N is the total number of available training patterns, and N1, N2 of them belong to ω1 and ω2, respectively, then P(ω1) ≈ N1/N and P(ω2) ≈ N2/N.
The other statistical quantities assumed to be known are the class-conditional probability density functions p(x|ωi), i = 1, 2, describing the distribution of the feature vectors in each of the classes. If these are not known, they ...
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.
Read now
Unlock full access