Machine Learning with SAS Viya

Chapter 10: Neural Networks: Optimizing the Model and Learning

Optimizing the Model

Avoiding Bad Local Minima

Details: Initialization Procedure

Shaping the Sigmoid

Parameter Estimation

Model Studio: Early Stopping

Numerical Optimization

Model Studio: Numerical Optimization Methods

Which Optimization Method Should You Use?

Regularize and Tune Model Hyperparameters

The Learning Rate

Summary of Hyperparameters

Model Studio Autotuning

Demo 10.1: Improving a Neural Network Model by Changing the Network Learning and Optimization Parameters 240

Quiz

Optimizing the Model

Now that we have changed the model architecture (in an attempt to improve the model), we are ready to optimize the complexity of the model. The way in which neural network models optimize ...