Learning Data Mining with Python - Second Edition

Intuition

The aspect that differentiates deep neural networks from the more basic neural network we saw in Chapter 8, Beating CAPTCHAs with Neural Networks, is size.

A neural network is considered deep when it has two or more hidden layers. In practice, a deep neural network is often much larger, both in the number of nodes in each layer and also the number of layers. While some of the research of the mid -2000s focused on very large numbers of layers, smarter algorithms are reducing the actual number of layers needed.

The size is one differentiator, but new layer types and neural network structures are assisting in creating deep neural networks for specific areas. We have already seen a feed-forward neural network composed of dense layers ...