Chapter 3. The Data Pipeline

So far, we've explored how to load data into Python and process it to create a bi-dimensional NumPy array containing numerical values (your dataset). Now, we are ready to immerse ourselves fully in data science, extract meaning from data, and develop potential data products. This chapter on data treatment and transformations and the next one on machine learning are the most challenging sections of the entire book.

In this chapter, you will learn how to:

  • Briefly explore data and create new features
  • Reduce the dimensionality of data
  • Spot and treat outliers
  • Decide on the best score or loss metrics for your project
  • Apply scientific methodology and effectively test the performance of your machine learning hypothesis
  • Reduce the ...

Get Python Data Science Essentials - Second Edition now with O’Reilly online learning.

O’Reilly members experience live online training, plus books, videos, and digital content from 200+ publishers.