Hands-On Meta Learning with Python

Memory-augmented neural networks (MANN)

Now we will see an interesting variant of NTM, called MANN. It is extensively used for one-shot learning tasks. MANN is designed to make NTM perform better at one-shot learning tasks. We know that NTM can either use content-based addressing or location-based addressing. But in MANN, we use only content-based addressing.

MANN uses a new addressing scheme called least recently used access. As the name suggests, it writes to the least recently used memory location. Wait. What? We just learned that MANN is not location-based, so why are we writing to the least recently used location? This is because the least recently used memory location is determined by the read operation and the read operation is performed ...