Hands-On Deep Learning Algorithms with Python

Reconstruction loss

In order to make sure that the network has learned the important features in the capsules, we use reconstruction loss. This means that we use a three-layer network called a decoder network, which tries to reconstruct the original image from the digit capsules:

Reconstruction loss is given as the squared difference between the reconstructed and original image, as follows:

The final loss is given as follows:

Here, alpha is ...