September 2019
Intermediate to advanced
420 pages
10h 29m
English
This is where backpropagation comes in, which is an algorithm for estimating the gradient of the cost function in neural networks. Some might say that it is basically a fancy word for the chain rule, which is a means to calculate the partial derivative of functions that depend on more than one variable. Nonetheless, it is a method that helped bring the field of artificial neural networks back to life, so we should be thankful for that.
Understanding backpropagation involves quite a bit of calculus, so I will only give you a brief introduction here.
Let's remind ourselves that the cost function, and therefore its gradient, depends on the difference between the true output (yi) and the current output (ŷi
Read now
Unlock full access