Hands-On Deep Learning Algorithms with Python

Paragraph Vector – Distributed Memory model

PV-DM is similar to the CBOW model, where we try to predict the target word given a context word. In PV-DM, along with word vectors, we introduce one more vector, called the paragraph vector. As the name suggests, the paragraph vector learns the vector representation of the whole paragraph and it captures the subject of the paragraph.

As shown in the following figure, each paragraph is mapped to a unique vector and each word is also mapped to a unique vector. So, in order to predict the target word, we combine the word vectors and paragraph vector by either concatenating or averaging them:

But having ...