13
Monitoring and Maintaining Azure Data Engineering Pipelines
12 chapters and 500+ pages into this book should have given you a fair understanding of building Data Factory/Synapse integration pipelines to ingest, process, and store your data. The next key aspect of Azure data engineering is to monitor and maintain the pipelines that you’ve developed.
In this chapter, we will cover the following recipes:
- Monitoring Synapse integration pipelines using Log Analytics and workbooks
- Tracing SQL queries for Synapse dedicated SQL pools to Synapse integration pipelines
- Provisioning a Microsoft Purview account and creating a data catalog
- Integrating a Synapse workspace with Microsoft Purview and tracking data lineage
- Applying Azure tags using PowerShell ...
Get Azure Data Engineering Cookbook - Second Edition now with the O’Reilly learning platform.
O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.
