Mastering Machine Learning with Spark 2.x

The CBOW model

First, let's consider a simple movie review, which will act as our base example in the next few sections:

Now, imagine that we have a window that acts as a slider, which includes the main word currently in focus (highlighted in red in the following image), in addition to the five words before and after the focus word (highlighted in yellow):

The words in yellow form the context that surrounds the current focus word, ideas. These context words act as inputs to our feed-forward neural network, whereby each word is encoded via one-hot-encoding ...