As mentioned earlier, it is necessary for the capsule in the lower layer to decide how to send its output to the higher-level capsules. This is achieved through the novel concept of the dynamic routing algorithm, which was introduced in the paper (https://arxiv.org/pdf/1710.09829.pdf). The key idea behind this algorithm is that the lower layer capsule will send their output to the higher-level capsules that match the input.
This is achieved through the weights (cij) mentioned in the last section. These weights multiply the outputs from the lower layer capsule i before pushing them as the input to the higher level capsule j. Some of the properties of these weights are as follows:
- cijs are non-negative in nature ...