Hands-On Deep Learning with R

Augmenting our neural network with backpropagation

At this point, we have a working neural network. For this simple example, we will add one additional feature of neural networks that can improve performance, which is backpropagation. A neural network can learn to solve a task by multiplying the variable by values so that the variables are weighted as they pass through hidden layers. The backpropagation step allows the model to traverse back through layers and adjust the weights that were learned during previous steps:

1. In practical terms, this step is quite straightforward to implement. We simply declare that we will use the backpropagation algorithm and indicate the learning rate, which controls how much the weights are adjusted. In general, ...