17 Airflow on Azure
This chapter covers
- Designing a deployment strategy for Azure
- An overview of several Azure-specific hooks and operators
- Demonstrating how to use Azure-specific hooks and operators with a use case
This chapter will dive further into how to deploy and integrate Airflow with cloud services in the Microsoft Azure cloud. First, we’ll start designing an Airflow deployment by mapping the different components of Airflow to Azure services. Then we’ll explore some of the hooks and operators that Airflow provides for integrating with several key Azure services. Finally, we’ll show how to use these Azure-specific operators and hooks to implement a use case for generating movie recommendations.
17.1 Deploying Airflow in Azure
In
Get Data Pipelines with Apache Airflow now with the O’Reilly learning platform.
O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.
