Hands-On Java Deep Learning for Computer Vision

Style cost function

Let's see how to get the correlations once you have the activations. Correlation will be calculated simply as the multiplication between the numbers of the activations. If the result is high, the multiplication result is high, then we say that those two activations are correlated together. Otherwise, if they are different and the multiplication has a low result, then they aren't correlated together. Since channels are feature detectors, we are more interested in channel correlation rather than some specific activations. So we are going to multiply all the activations between two channels, and then we'll sum up to get some value as shown in the following image, and that value will tell us the degree of correlation between ...