April 2021
Intermediate to advanced
316 pages
5h 32m
English
While exploring stochastic gradient descent in Chapter 3, we treated the computation of gradients of the loss function 𝛻xL(x) as a black box. In this chapter, we open the black box and cover the theory and practice of automatic differentiation, as well as explore PyTorch’s Autograd module that implements the same. Automatic differentiation is a mature method that allows for the effortless and efficient computation of gradients of arbitrarily complicated loss functions. This is critical when ...
Read now
Unlock full access