The concept of MANNs was first introduced with the concept of the neural Turing machine (NTM) (for more information, go to https://arxiv.org/abs/1410.5401). The NTM has two components:
- A NN controller.
- An external memory, represented as a matrix
. The matrix contains n rows of d-dimensional vectors.
The following diagram provides an overview of the NTM architecture:
NTM Source: https://arxiv.org/abs/1410.5401
An NTM works in a sequential fashion (like an RNN), where the controller takes input vectors and produces output ...
