10

Monitoring and Troubleshooting Data Pipelines

Azure Data Factory is an orchestration and integration tool that helps engineers transfer data between multiple data stores, both within and outside of the Microsoft Azure ecosystem. However, data integration is rarely straightforward, and errors can and do occur. In this chapter, we will introduce tools to help you manage and monitor your Azure Data Factory pipelines. You will learn where and how to find more information about what went wrong when a pipeline failed, how to debug a failed run, how to set up alerts that notify you when there is a problem, and how to identify problems with your integration runtimes.

The following is a list of the recipes in this chapter:

  • Monitoring pipeline runs ...

Get Azure Data Factory Cookbook - Second Edition now with the O’Reilly learning platform.

O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.