September 2019
Intermediate to advanced
416 pages
13h 49m
English
book
Deep Learning Illustrated: A Visual, Interactive Guide to Artificial Intelligence
by Jon Krohn, Grant Beyleveld, Aglaé Bassens
Content preview from Deep Learning Illustrated: A Visual, Interactive Guide to Artificial Intelligence
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
Start your free trial
C. PyTorch
In this appendix, we’ll introduce the distinguishing elements of PyTorch, including contrasting it with its primary competition—TensorFlow.
PyTorch Features
In Chapter 14, we introduced PyTorch at a high level. In this section, we continue by examining the library’s core attributes.
Autograd System
PyTorch operates using what’s called an autograd system, which relies on the principle of reverse-mode automatic differentiation. As detailed in Chapter 7, the end product of forward propagating through a deep neural network is the result of a series of functions chained together. Reverse-mode automatic differentiation applies the chain rule to differentiate the inputs with respect to the cost at the end, working backwards (introduced ...