Forward propagation in RNNs

Let's look at how an RNN uses forward propagation to predict the output; but before we jump right in, let's get familiar with the notations:

The preceding figure illustrates the following:

  • represents the input to hidden layer weight matrix
  • represents the hidden to hidden layer weight matrix
  • represents the hidden to ...

Get Hands-On Deep Learning Algorithms with Python now with the O’Reilly learning platform.

O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.