All the magic in this model lies behind the RNN cells. In our simple example, each cell presents the same equations, just with a different set of variables. A detailed version of a single cell looks like this:
First, let's explain the new terms that appear in the preceding diagram:
- Weights (, , ): A weight is a matrix (or a number) ...