Python Deep Learning

Chapter 3. Deep Learning Fundamentals

In Chapter 1, Machine Learning – An Introduction, we introduced machine learning and some of its applications, and we briefly talked about a few different algorithms and techniques that can be used to implement machine learning. In Chapter 2, Neural Networks, we concentrated on neural networks; we have shown that 1-layer networks are too simple and can only work on linear problems, and we have introduced the Universal Approximation Theorem, showing how 2-layer neural networks with just one hidden layer are able to approximate to any degree any continuous function on a compact subset of R _n.

In this chapter, we will introduce deep learning and deep neural networks, that is, neural networks with at least two ...