3 Introducing Dask DataFrames

This chapter covers

  • Defining structured data and determining when to use Dask DataFrames
  • Exploring how Dask DataFrames are organized
  • Inspecting DataFrames to see how they are partitioned
  • Dealing with some limitations of DataFrames

In the previous chapter, we started exploring how Dask uses DAGs to coordinate and manage complex tasks across many machines. However, we only looked at some simple examples using the Delayed API to help illustrate how Dask code relates to elements of a DAG. In this chapter, we’ll begin to take a closer look at the DataFrame API. We’ll also start working through the NYC Parking Ticket data following a fairly typical data science workflow. This workflow and their corresponding chapters ...

Get Data Science with Python and Dask now with O’Reilly online learning.

O’Reilly members experience live online training, plus books, videos, and digital content from 200+ publishers.