2 Anatomy of an Airflow DAG

This chapter covers

  • Running Airflow on your own machine
  • Writing and running your first workflow
  • Examining the first view at the Airflow interface
  • Handling failed tasks in Airflow

In the previous chapter, we learned why working with data and the many tools in the data landscape is not easy. In this chapter, we get started with Airflow and check out an example workflow that uses basic building blocks found in many workflows.

It helps to have some Python experience when starting with Airflow since workflows are defined in Python code. The gap in learning the basics of Airflow is not that big. Generally, getting the basic structure of an Airflow workflow up and running is easy. Let’s dig into a use case of a rocket ...

Get Data Pipelines with Apache Airflow now with the O’Reilly learning platform.

O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.