Hands-On One-shot Learning with Python

Architecture of an NTM

Modern computers have evolved a lot over the past 50 years; however, they are still composed of three systems—memory, control flow, and arithmetic/logic operations. Research from the fields of biology and computational neuroscience provide extensive evidence that memory is crucial in the quick and meaningful storage and retrieval of information. Taking inspiration from this, an NTM is fundamentally composed of a neural network, consisting of a controller and a two-dimensional matrix called the memory bank (or memory matrix). At each time step, the neural network receives some input and generates output corresponding to that input. In the process of doing so, it also accesses the internal memory bank and performs read ...