Let's look at how an RNN uses forward propagation to predict the output; but before we jump right in, let's get familiar with the notations:
The preceding figure illustrates the following:
- represents the input to hidden layer weight matrix
- represents the hidden to hidden layer weight matrix
- represents the hidden to ...