Skip to Main Content
Accelerate Model Training with PyTorch 2.X
book

Accelerate Model Training with PyTorch 2.X

by Maicon Melo Alves
April 2024
Intermediate to advanced content levelIntermediate to advanced
230 pages
5h 12m
English
Packt Publishing
Content preview from Accelerate Model Training with PyTorch 2.X

9

Training with Multiple CPUs

When accelerating the model-building process, we immediately think of machines endowed with GPU devices. What if I told you that running distributed training on machines equipped only with multicore processors is possible and advantageous?

Although the performance improvement obtained from GPUs is incomparable, we should not disdain the computing power provided by modern CPUs. Processor vendors have continuously increased the number of computing cores on CPUs, besides creating sophisticated mechanisms to treat access contention to shared resources.

Using CPUs to run distributed training is especially interesting for cases where we do not have easy access to GPU devices. Thus, learning this topic is vital to enrich ...

Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.
Start your free trial

You might also like

PyTorch Recipes: A Problem-Solution Approach to Build, Train and Deploy Neural Network Models

PyTorch Recipes: A Problem-Solution Approach to Build, Train and Deploy Neural Network Models

Pradeepta Mishra

Publisher Resources

ISBN: 9781805120100Supplemental Content