Probabilistic Latent Semantic Analysis

The previous model was based on a deterministic approach, but it's also possible to define a probabilistic model PLSA over the space determined by documents and words. In this case, we're not making any assumption about Apriori probabilities (this will be done in the next approach), and we're going to determine the parameters that maximize the log-likelihood of our model. In particular, consider the plate notation (if you want to know more about this technique, read https://en.wikipedia.org/wiki/Plate_notation) shown in the following diagram:

Plate diagram for PLSA

We assume we have a corpus of m documents, ...

Get Machine Learning Algorithms - Second Edition now with the O’Reilly learning platform.

O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.