Measuring text similarity with Cosine Similarity measure using Java 8

Data scientists often measure the distance or similarity between two data points--sometimes for classification or clustering, sometimes for detecting outliers, and for many other cases. When they deal with texts as data points, the traditional distance or similarity measurements cannot be used. There are many standard and classic as well as emerging and novel similarity measures available for comparing two or more text data points. In this recipe, we will be using a measurement named Cosine Similarity to compute distance between two sentences. Cosine Similarity is considered to be a de facto standard in the information retrieval community and therefore widely used. In this recipe, ...

Get Java Data Science Cookbook now with the O’Reilly learning platform.

O’Reilly members experience live online training, plus books, videos, and digital content from nearly 200 publishers.