This type of layer is exactly the same as any of the layers of a classical ANN with fully connected (FC) architecture. Simply in an FC layer, each neuron is connected to all the neurons of the previous layer, specifically to their activations.
This type of layer, unlike what has been seen so far in CNNs, does not use the property of local connectivity. An FC layer is connected to the entire input volume, and, therefore, as you can imagine, there will be many connections. The only settable parameter of this type of layer is the number of K neurons that make it up. What basically defines an FC layer is as follows: connecting its K neurons with all the input volume and calculating the activation of each of its K neurons. ...
