Mapping Data Flows in Azure Data Factory: Building Scalable ETL Projects in the Microsoft Cloud

© The Author(s), under exclusive license to APress Media, LLC, part of Springer Nature 2022

M. KromerMapping Data Flows in Azure Data Factoryhttps://doi.org/10.1007/978-1-4842-8612-8_10

10. Monitor, Manage, and Optimize

Mark Kromer¹  

(1)

SNOHOMISH, WA, USA

 

This chapter is going to cover a lot of ground. There is also an expectation that you’ve made your way through most of the earlier chapters and feel comfortable building ETL pipeline in ADF using Mapping Data Flows as by this part of the book, I’m going to make a number of assumptions in terms of your understanding of ADF and Mapping Data Flows.

After you’ve deployed and operationalized your factory, you’ll want to monitor the health of your scheduled pipelines and data flows and look for ways ...