Feed-forward backpropagation is a method through which we can predict things such as weights, and ultimately the outcome of a neural network.
According to this method, the following iterations occur on predictions:
- If a prediction is correct, the weight associated with it is strengthened. Imagine the neural network saying, Hey, you know what, we used the weight of 0.75 for the first part of this equation for the first predictor and we got the correct prediction; that's probably a good starting point.
- Suppose the prediction is incorrect; the error is fed back or back propagated into the model so that the weights or weight coefficients are modified, as shown here:
This backpropagation won't just take place in-between ...