Sampling the layers by convolution

The layers can be upsampled or downsampled directly using convolution. The stride used for convolution can be increased to cause downsampling as shown here:

Downsampling by convolution is called atrous convolution or dilated convolution or strided convolution. Similarly, it can be reversed to upsample by learning a kernel as shown here:

Upsampling directly using a convolution can be termed as transposed convolution. Some other synonyms are deconvolution or fractionally strided convolution or up-convolution ...

Get Python: Advanced Guide to Artificial Intelligence now with O’Reilly online learning.

O’Reilly members experience live online training, plus books, videos, and digital content from 200+ publishers.