Apache Spark for Machine Learning

5

Building a Classification System

In this chapter, we’ll look into classification, a type of supervised learning and a cornerstone of machine learning that has revolutionized the way we interpret and categorize data. As discussed in the previous chapter, supervised learning, at its core, involves training a model on a labeled dataset where each example is paired with the correct output, enabling the model to learn the mapping from inputs to outputs. Within this vast realm, classification stands out as a critical task that assigns inputs to two or more classes, making it indispensable for a myriad of applications, from email filtering to medical diagnosis.

We’ll begin by laying out the foundational concepts of supervised learning. With a strong ...