Deep Learning Essentials

Basic RNN model

Figure Basic RNN model describes a basic RNN model in more detail. As you can see, this is a simple one-to-many RNN model. If you just focus on nodes X₁, h₁, and Y₁, they are very similar to a one-layer neural network. The only additions to this RNN model are the steps in time when hidden neurons take on different values, such as h₂ and h₃. The overall sequence of operations in this RNN model is as follows:

• Time step t1 where X₁ is input to the RNN model
• Time step t1 where h1 is computed based on input X1
• Time step t1 where Y1 is computed based on input h1
• Time step t2 where h2 is computed based on input h1
• Time step t2 where Y2 is computed based on input h2
• Time step t3 where h3 is computed based on input h2
• Time step t3 ...