The Data Science Workshop - Second Edition

7

7. The Generalization of Machine Learning Models

Overview

This chapter will teach you how to make use of the data you have to train better models by either splitting your data if it is sufficient or making use of cross-validation if it is not. By the end of this chapter, you will know how to split your data into training, validation, and test datasets. You will be able to identify the ratio in which data has to be split and also consider certain features while splitting. You will also be able to implement cross-validation to use limited data for testing and use regularization to reduce overfitting in models.

Introduction

In the previous chapter, you learned about model assessment using various metrics such as R2 score, MAE, and accuracy. ...