The concept of deep learning originated from artificial neural networks research, in which feed-forward neural networks or multilayer perceptrons (MLPs) with many hidden layers are often referred as deep neural networks (DNNs).
The MLP networks are generally trained by a gradient descent algorithm, designated by backpropagation (BP). The idea of BP is simple: for each set of input/output, you compare the signal from the last layer of the neural network ...