October 2017
Beginner to intermediate
270 pages
7h
English
In this part of the sequence, we will finally pass through the information filter we have been configuring, and as a result, we will have an updated long-term state.
In order to normalize the new and short-term information, we pass the new input and the short-term state via a neural network with tanh activation. This will allow us to feed the new information in a normalized [-1,1] range:

Read now
Unlock full access