Data Mesh

Prologue: Imagine Data Mesh

Imagination will often carry us to worlds that never were. But without it we go nowhere.

Carl Sagan

Behind every successful company stand three, failed and forgotten. This is a ratio by which the failures outnumber the survivors.¹ In the age of AI, it is no curious coincidence that the ones standing and leading have cracked the code of complexity, embedded data-driven experimentation in every aspect of their business, embraced continuous change in response to rapid learnings, and partnered with machine intelligence to understand reality beyond human logic and reasoning.

Daff, Inc.,² a fictional global music and audio streaming company,³ is an example of such a company. Daff has successfully delivered on its mission: “Connect artists and listeners across the globe, in an immersive artistic experience, at every moment of life.” Behind Daff’s mission stands the company’s great expectations from data, analytics, and machine intelligence, delivered through an approach known as data mesh. Data mesh is the backbone of Daff’s data strategy, architecture, and operating model that has given them scale and speed to experiment, learn, and adapt using data and machine learning (ML).

What I want to share with you is Daff’s story after they have implemented data mesh. Through the story of Daff you will learn the essence of data mesh. You will see data mesh principles applied, its benefits demonstrated, its architecture in action, and the organizational structure, ...