December 2022
Intermediate to advanced
282 pages
5h 1m
English
In this chapter, you will use PyTorch to implement the steps that are most commonly used in installation, training, and setting up distributed PyTorch for model training. The architecture followed for distributed data parallel training and distributed model parallel training can be explained using the following figures. The model optimization process reduces the model parameter’s size so that the model object becomes lighter. The bigger the model object, the slower the inference ...