Naïve Bayes Classifier

A naïve Bayes classifier is based on the Bayes theorem. Hence, this chapter first reviews the Bayes theorem and then describes naïve Bayes classifier. A list of data mining software packages that support the learning of a naïve Bayes classifier is provided. Some applications of naïve Bayes classifiers are given with references.

3.1    Bayes Theorem

Given two events A and B, the conjunction (∧) of the two events represents the occurrence of both A and B. The probability, P(AB) is computed using the probability of A and B, P(A) and P(B), and the conditional probability of A given B, P(A|B), or B given A, P(B|A):



The Bayes theorem is derived from Equation 3.1:


Get Data Mining now with the O’Reilly learning platform.

O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.