6

Root Cause Analysis

Creating rules and expectations is one thing, as it allows you to detect any issues in your data, but troubleshooting is another.

An observed system should give you many clues and means to check the origin of the error, which will lead to efficient data issue resolution.

In a company, resources are key. The team’s time should be dedicated to value creation, not maintenance or troubleshooting under pressure. You need to know how to use the resources efficiently to avoid wasting time and, ultimately, money.

The best way to keep these costs under control is to evaluate them using key performance indicators (KPIs). Some interesting team or project metrics that you may like to follow include the mean time to detect and the mean ...

Get Data Observability for Data Engineering now with the O’Reilly learning platform.

O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.