Grokking Deep Learning

Chapter 10. Neural learning about edges and corners: intro to convolutional neural networks

In this chapter

• Reusing weights in multiple places
• The convolutional layer

“The pooling operation used in convolutional neural networks is a big mistake, and the fact that it works so well is a disaster.”

Geoffrey Hinton, from “Ask Me Anything” on Reddit

Reusing weights in multiple places

If you need to detect the same feature in multiple places, use the same weights!

The greatest challenge in neural networks is that of overfitting, when a neural network memorizes a dataset instead of learning useful abstractions that generalize to unseen data. In other words, the neural network learns to predict based on noise in the dataset as opposed to relying ...