1.1 Introduction and biological inspiration1.2 Brief history of ANN developmentORIGINSTHE QUIET YEARSINTEREST REVIVAL1.3 Artificial neural network types1.4 Simple formal neurons1.4.1 Mc Culloch–Pitt neuron1.4.2 The perceptron1.5 Hebb learning rule (1949)1.5.1 The Hebb learning rule applied to a sign-type neuron1.5.2 Hebb learning rule used for a Perceptron type neuron1.6 Perceptron learning rule1.7 Classification and linear separability1.7.1 Classification1.7.2 Discriminant functions1.7.3 Linear separability1.7.4 Example: Implementation of the AND function using a single neuron1.8 Linear combiner and the LMS algorithm1.9 Gradient descent optimisation1.9.1 Stability and learning rate1.9.2 Generalisation to a multi-dimensional system1.10 LMS learning algorithm1.10.1 The Adaline1.10.2 The Delta learning rule1.10.3 Derivation of the Delta learning rule1.10.4 Derivative evaluation for the Delta learning rule