Neural Network Projects with Python

LSTMs – the intuition

As we explained in the previous section, LSTMs were designed to overcome the problem with long-term dependencies. Let's assume we have this movie review:

Our task is to predict whether the reviewer liked the movie. As we read this review, we immediately understand that this review is positive. In particular, the following words (highlighted) are the most important:

If we think about it, only the highlighted words are important, and we can ignore the rest of the words. This is an important strategy. By selectively remembering ...