April 2017
Intermediate to advanced
320 pages
7h 46m
English
The state vector St is calculated starting from the current input and the state vector in previous time, through the U and W matrices:
f is a nonlinear function such as tanh or ReLU. As you can see, the two terms in the function are added together before being processed by the function itself.
Finally, Ot; is the network output, calculated using the matrix V:
Read now
Unlock full access