Hands-On One-shot Learning with Python

Addressing

The key to the read and write operations is the weight vector, which indicates which rows to read from/write to. The controller produces this weight vector in four stages. Each stage produces an intermediate vector that gets passed to the next stage:

• The first stage is content-based addressing, the goal of which is to generate a weight vector based on how similar each row is to the given key vector, k_t, of length C. More precisely, the controller emits vector k_t that is compared to each row of M_t using a cosine similarity measure, defined as follows:

The content weight vector is not normalized yet, so it is normalized with the ...