Neural Network Projects with Python

What's inside an LSTM network?

LSTMs have the same repeating structure of RNNs that we have seen previously. However, LSTMs differ in their internal structure.

The following diagram shows a high-level overview of the repeating unit of an LSTM:

The preceding diagram might look complicated to you now, but, don't worry, as we'll go through everything step by step. As we mentioned in the previous section, LSTMs have the ability to selectively remember important inputs and to forget the rest. The internal structure of an LSTM allows it to do that.

An LSTM differs from a conventional RNN in that it has a cell state, in addition to the hidden state. ...