Chapter 8: Deploying Azure Data Factory Pipelines

In previous chapters, we have talked about creating Azure Data Factory pipelines for different data engineering use cases, and also learned the different activities and data flows available in Azure Data Factory. In this chapter, we'll talk about continuous integration and deployment of Azure Data Factory pipelines.

We'll first learn to manually deploy pipelines across different environments, such as development, testing, and production, and will then use Azure DevOps to automate the deployment process.

In this chapter, we'll cover the following recipes:

  • Configuring the development, test, and production environments
  • Deploying Azure Data Factory pipelines using the Azure portal and ARM templates ...

Get Azure Data Engineering Cookbook now with the O’Reilly learning platform.

O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.