MATLAB Deep Learning: With Machine Learning, Neural Networks and Artificial Intelligence

© Phil Kim 2017

Phil KimMATLAB Deep Learning10.1007/978-1-4842-2845-6_3

3. Training of Multi-Layer Neural Network

Phil Kim¹ 

(1)

Seoul, Soul-t’ukpyolsi, Korea (Republic of)

 

In an effort to overcome the practical limitations of the single-layer, the neural network evolved into a multi-layer architecture. However, it has taken approximately 30 years to just add on the hidden layer to the single-layer neural network. It’s not easy to understand why this took so long, but the problem involved the learning rule. As the training process is the only method for the neural network to store information, untrainable neural networks are useless. A proper learning rule for the multi-layer neural network took quite some time to develop.

The previously introduced ...