Designing Data Governance from the Ground Up

Use Data Lineage Tracking

Data lineage plays a key role in your plan to embed data governance into engineering. It confirms where the data comes from, recording the path it takes over time and visualizing its flow from one system to the next. In most organizations, the same data spans several projects and pipelines. Data lineage helps data scientists track errors and find those errors’ root causes. This plays a key role in your data governance, especially when it comes to fulfilling transparency and bias reduction.

For instance, let’s say that your data team built an algorithm which intends to help HR review resumes for C-level roles. Post-deployment, your HR director tells the governance council that she isn’t receiving applications from women. ...