Chapter 8: Deploying Azure Data Factory Pipelines

In previous chapters, we have talked about creating Azure Data Factory pipelines for different data engineering use cases, and also learned the different activities and data flows available in Azure Data Factory. In this chapter, we'll talk about continuous integration and deployment of Azure Data Factory pipelines.

We'll first learn to manually deploy pipelines across different environments, such as development, testing, and production, and will then use Azure DevOps to automate the deployment process.

In this chapter, we'll cover the following recipes:

  • Configuring the development, test, and production environments
  • Deploying Azure Data Factory pipelines using the Azure portal and ARM templates ...

Get Azure Data Engineering Cookbook now with O’Reilly online learning.

O’Reilly members experience live online training, plus books, videos, and digital content from 200+ publishers.