O'Reilly logo

Hands-On Natural Language Processing with Python by Rajalingappaa Shanmugamani, Rajesh Arumugam

Stay ahead with the world's most comprehensive technology and business learning platform.

With Safari, you learn the way you learn best. Get unlimited access to videos, live online training, learning paths, books, tutorials, and more.

Start Free Trial

No credit card required

Sentence2vec

One of the major drawbacks of the method that we discussed previously (for obtaining document-level vector representations) is that the words present in the document are given equal weight age. Such an approach suppresses the importance of certain words in the sentence, which actually add value to the meaning of the document. Let us discuss this point with a concrete example of how the method builds a document-level vector representation. Take a look at the sentence, Jack and Jill went up the hill to fetch a pail of water. In the sentence, the words that provide the most context about the action happening are Jack, Jill, hill, fetch, pail, and water. However, the preceding method builds the representation with equal weight given ...

With Safari, you learn the way you learn best. Get unlimited access to videos, live online training, learning paths, books, interactive tutorials, and more.

Start Free Trial

No credit card required