16 High Performance Programming for Soft Computing
and Hoff in 1960 introduced the Least Mean-Squared algorithm (LMS)
that was used to formulate the ADaptive LINnear Element (ADALINE). In
1962, Widrow and his students proposed one of the fi rst trainable layered
neural network consisting of using several (multiple) adaptive elements
(ADALINEs), hence the name MADALINE. In 1969, Minski and Papert
demonstrated that there are fundamental limitations about a single layer
that a perceptron can compute; however, they stated that there was no reason
to think that such limitation could be overcome using a multilayer version.
In those times, the use of multilayer perceptrons was hampered by the
problem of assigning credit to the hidden neurons in the ...