Deep Learning with PyTorch Quick Start Guide

Hyper-parameters and multilayered networks

Now that you understand the process of building, training, and testing models, you will see that expanding these simple networks to increase performance is relatively straightforward. You will find that nearly all models we build consist, essentially, of the following six steps:

1. Import data and create iterable data-loader objects for the training and test sets
2. Build and instantiate a model class
3. Instantiate a loss class
4. Instantiate an optimizer class
5. Train the model
6. Test the model

Of course, once we complete these steps, we will want to improve our models by adjusting a set of hyper-parameters and repeating the steps. It should be mentioned that although we generally consider hyper-parameters things ...