Deep Learning Quick Reference

Local connectivity

Filters focus on connectivity between adjacent pixels, because of their fixed size. This means that they will most strongly learn local features. When combined with other filters in layers, and nonlinearities, this allows us to gradually pay attention to larger and more complex features. This stacking of localized features is really desirable and a key reason why convolutional layers are so great.