Hands-On Machine Learning on Google Cloud Platform
by Giuseppe Ciaburro, V Kishore Ayyadevara, Alexis Perrier, Bryan Fry, Antonio Gulli
Removing outliers
So far we have seen different techniques for identifying possible outliers. What should we do after identifying them? After identifying the values that are outliers in the column, you need to determine whether these values are valid or invalid for the dataset.
If these are invalid values due to an error in the population phase of the dataset, then we must correct them. This operation may involve the replacement of this value with a presumably valid one or the removal of the entire row. In this latter case, we must pay attention to the weight that this action can have on the whole dataset.
To replace the value 100, which seems to us an invalid value in all respects (maybe it was 10 and an extra zero was added), we can ...
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.
Read now
Unlock full access