Hands-On Meta Learning with Python

NTM

NTM is an interesting algorithm that has the ability to store and retrieve information from memory. The idea of NTM is to augment the neural network with an external memory—that is, instead of using hidden states as a memory, it uses an external memory for storing and retrieving the information. The architecture of NTM is shown in the following figure:

The important components of the NTM are as follows:

• Controller: This is basically a feedforward neural network or recurrent neural network. It reads from and writes to the memory.
• Memory: The memory matrix or memory bank, or simply the memory, is where we will store the information. Memory ...