In the 1950s, American psychologist and artificial intelligence researcher Frank Rosenblatt invented an algorithm that would automatically learn the optimal weight coefficients w0 and w1 needed to perform an accurate binary classification: the perceptron learning rule.
Rosenblatt's original perceptron algorithm can be summed up as follows:
- Initialize the weights to zero or some small random numbers.
- For each training sample si, perform the following steps:
- Compute the predicted target value ŷi.
- Compare ŷi to the ground truth yi, and update the weights accordingly:
- If the two are the same (correct prediction), skip ahead.
- If the two are different (wrong prediction), push the weight coefficients w0 and w1 towards ...