Practical Applications of Data Mining

6.4 parameters of the learNiNg proCess 233

Compute the validation error rate periodically during training. 5.

Stop training when the validation error rate “starts to go up.”6.

6.4.4 Convergence Curve (Back-Propagation 

Neural Network)

How can we determine when the iteration process should be stopped? The

total mean-square error for the network can be used to determine this because

it measures the oscillation rate for convergence. Comparing Figure 6.2 with

Figure 6.3, we find that there are more oscillations in Figure 6.3. Since oscil-

lation hinders the convergence process of the network, the process shown in

Figure 6.2 is a better learning ...