Keras Deep Learning Cookbook

The need for RNNs

Traditional neural networks cannot remember their past interactions, and that is a significant shortcoming. RNNs address this issue. They are networks with loops in them, allowing information to persist. RNNs have loops. In the next diagram, a chunk of the neural network, A, looks at some input, x_t, and outputs a value, h_t. A loop in the network allows information to be passed from one step of the network to the next.

This diagram shows what a neural network looks like: