Streaming Data Mesh

Chapter 5. Federated Computational Data Governance

Governance provides the interoperability and controls to allow domains to work together while protecting each one from unwanted activity. Moreover, data governance in a streaming data mesh provides a centralized, distributed way to manage domain operations, metadata, and service definitions. That is what we will focus on when defining policies and controls in a streaming data mesh.

The federated data governance in a streaming data mesh is tasked to create a harmonious community of domains sharing data with one another while maintaining domain autonomy.

Chapter 1 discussed the idea of having multiple meshes within a streaming data mesh—meshes that stretch beyond data. One of these is a mesh for streaming data governance. This idea of a data governance mesh is similar to the state and federal governance relationship we see in society today. A state or local government has autonomy over a certain region, whereas the federal government provides overarching policies that impact operations at the state and local level. The goal of this relationship is to create harmonious communities. The same applies to a streaming data mesh. We can think of state and local governments as domains that control the data governance only within the bounds of their domain, while the federated computational data governance is akin to the federal government that enforces policies that maintain harmony between domains.

Computational in federated computational ...