The dynamic routing algorithm

As mentioned earlier, it is necessary for the capsule in the lower layer to decide how to send its output to the higher-level capsules. This is achieved through the novel concept of the dynamic routing algorithm, which was introduced in the paper (https://arxiv.org/pdf/1710.09829.pdf). The key idea behind this algorithm is that the lower layer capsule will send their output to the higher-level capsules that match the input. 

This is achieved through the weights (cij) mentioned in the last section. These weights multiply the outputs from the lower layer capsule i before pushing them as the input to the higher level capsule j. Some of the properties of these weights are as follows:

  • cijs are non-negative in nature ...

Get TensorFlow Machine Learning Projects now with the O’Reilly learning platform.

O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.