Hands-On Convolutional Neural Networks with TensorFlow

Bias and Variance

Variance and Bias is another way of saying overfitting and underfitting respectively, as discussed in Chapter 2, Deep Learning and Convolutional Neural Networks. We can diagnose the problem of "underfitting" and "overfitting" using the train set, dev set and test set errors.

Consider the following scenario where we have data coming from two different distributions named as Distribution 1 and Distribution 2. Distribution 2 represents the target application which we care about. The question is, how do we define train, dev and test sets on such distributions.

The best way to do so is to split it according to the preceding figure. ...