Implementing Data Mesh

Chapter 9. Running and Operating Your Data Mesh

At this point, you have read the chapters on data product and Data Mesh architecture as well as on how to define data products using data contracts, how to build data products, and how to bind your data products into a broader Data Mesh. In this chapter, we’ll explore how to run and operate your data products: how to make your data products discoverable, observable, and secure. And then we suggest that Data Mesh and data products make data “dynamic”—that data is not just inert bits on a storage medium but rather that the Data Mesh principles of clear boundaries and a self-serve capability introduce a whole new set of opportunities.

Making Data Products Discoverable, Observable, and Secure

Adopting a Data Mesh model brings unique challenges and opportunities, requiring a comprehensive reevaluation of how data is approached, handled, and leveraged within an organization. At its core, the Data Mesh philosophy views data not merely as a static resource but rather as a dynamic, valuable product with its own lifecycle. This perspective demands a holistic understanding of various key themes: observability, operability, security and identity management, performance management, and day-to-day governance. Each of these themes plays a pivotal role in ensuring that a Data Mesh operates efficiently, securely, and in alignment with the organization’s broader objectives.

Observability within Data Mesh is essential for gaining deep insights into ...