Designing Data Governance from the Ground Up

Give Your Data Stewards Room to Fail

Remember, you’re in the governance-driven development stage, not the production stage. Once you’ve progressed to production, the time for experiments is done. Until then, use development as your sandbox to learn what does and doesn’t work for your data project.

This is especially crucial if you’re using new or immature tech. Managing big data demands a lot of moving parts under the hood. Xu describes this challenge when explaining how Netflix transitioned its data platform into containerized cloud infrastructure:

“There are hundreds of thousands of physical machines powering the cloud in each data center underneath the hood. At this scale, hardware failures are inevitable. When these failures arise unexpectedly, ...