5.2 Using Files for Large Data Sets
All of the examples in the Introducing the Python Collections chapter used small data sets so that we could concentrate on developing the statistical methods needed to analyze the data. We assumed that our data items were stored in lists, and we constructed our functions to process those lists accordingly. Now that we have those functions in place, we can turn our attention to using statistical tools to describe larger data sets.
We have already seen that Python provides some powerful collections in which to store and manipulate data. However, as the amount of data gets larger, it becomes more difficult to store the data in the collections for later processing. It would certainly be possible to have the ...
Get Python Programming in Context, 3rd Edition now with the O’Reilly learning platform.
O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.
