Skip to Main Content
Accelerate Model Training with PyTorch 2.X
book

Accelerate Model Training with PyTorch 2.X

by Maicon Melo Alves
April 2024
Intermediate to advanced content levelIntermediate to advanced
230 pages
5h 12m
English
Packt Publishing
Content preview from Accelerate Model Training with PyTorch 2.X

1

Deconstructing the Training Process

We already know that training neural network models takes a long time to finish. Otherwise, we would not be here discussing ways to run this process faster. But which characteristics make the building process of these models so computationally heavy? Why does the training step take so long? To answer these questions, we need to understand the computational burden of the training phase.

In this chapter, we will first remember how the training phase works under the hood. We will understand what makes the training process so computationally heavy.

Here is what you will learn as part of this first chapter:

  • Remembering the training process
  • Understanding the computational burden of the training phase
  • Understanding ...
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.
Start your free trial

You might also like

PyTorch Recipes: A Problem-Solution Approach to Build, Train and Deploy Neural Network Models

PyTorch Recipes: A Problem-Solution Approach to Build, Train and Deploy Neural Network Models

Pradeepta Mishra

Publisher Resources

ISBN: 9781805120100Supplemental Content