Neural Network Projects with Python

Long- and short-term dependencies in RNNs

The architecture of an RNN makes it ideal for handling sequential data. Let's take a look at some concrete examples, to understand how an RNN handles different lengths of sequential data.

Let's first take a look at a short piece of text as our sequential data:

We can treat this short sentence as sequential data by breaking it down into five different inputs, with each word at each time step. This is illustrated in the following diagram:

Now, suppose that we are building a simple RNN to predict whether ...