Chapter 5. Data assessment: poking and prodding

This chapter covers

  • Descriptive statistics and other techniques for learning about your data
  • Checking assumptions you have about your data and its contents
  • Sifting through your data for examples of things you want to find
  • Performing quick, rough analyses to gain insight before spending a lot of time on software or product development

Figure 5.1 shows where we are in the data science process: assessing the data available and the progress we’ve made so far. In previous chapters we’ve searched for, captured, and wrangled data. Most likely, you’ve learned a lot along the way, but you’re still not ready to throw the data at the problem and hope that questions get answered. First, you have to ...

Get Think Like a Data Scientist: Tackle the data science process step-by-step now with O’Reilly online learning.

O’Reilly members experience live online training, plus books, videos, and digital content from 200+ publishers.