Machine learning case study in Spark

In this section, we will look into how to implement text classification using the Spark ML and Naive Bayes algorithms. The classification of text is one of NLP's most common cases of use. Text classification can be used to detect email spam, identify retail product hierarchy, and analyze feelings. This process is typically a problem of classification in which we try to identify a specific subject from a natural language source with a large volume of data. We can discuss several topics within each of the data groups and it is therefore important to classify the article or textual information in logical groups. The techniques of text classification help us to do this. These techniques require a lot of computing ...

Get Mastering Hadoop 3 now with the O’Reilly learning platform.

O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.