Hands-On Machine Learning with C++

GRUs

The GRU is a variation of the LSTM architecture. They have one less gate (filter), and the connections are implemented differently. In this variant, the forget gate and the input gate are combined into one update gate. Besides this, the cell state and the latent state are combined. The resulting model is simpler than standard LSTM models, and as a result, it is gaining more popularity:

The updated gate determines how much information should remain from the last state and how much should be taken from the previous layer:

The reset gate ...