In this part of the book, in the second phase of our toolchain (see Figure III-1) we take the Nobel Prize dataset we just scraped with Scrapy in Chapter 6 and first clean it up, then explore it for interesting nuggets. The principal tools we’ll be using are the large Python libraries Matplotlib and Pandas.
Pandas will be introduced in the next couple of chapters, along with its building block, NumPy. In Chapter 9 we’ll use Pandas to clean the Nobel dataset. Then in Chapter 11, in conjunction with Python’s plotting library Matplotlib, we’ll use it to explore it.
In Part IV we’ll see how to deliver the freshly cleaned Nobel Prize dataset to the browser, using Python’s Flask web server.