January 2018
Beginner to intermediate
284 pages
8h 35m
English
The forget gate decides which memory we’d like to keep or throw away from the past cell state
. This is achieved by piping the
through an activation/squashing function (sigmoid) to obtain an indicator vector, and then multiplying this vector (gating) by the previous cell state vector
.
The result
represents the kept information ...
Read now
Unlock full access