Deciphering Data Architectures

Chapter 15. People and Processes

In the complicated world of data architectures, while technology and tools might command the spotlight, people and processes form its heart and soul. As organizations transition from traditional data models to innovative structures like MDW, data fabric, or data lakehouse, and even further into decentralized paradigms like data mesh, the human element remains central. But why?

In my many years building data warehouses, applications, and reporting projects, I have seen what helps projects succeed and what makes them fail. Imagine constructing an architectural marvel—a skyscraper with state-of-the-art amenities. The blueprint is flawless, the materials top-notch. Yet if the builders, engineers, and managers aren’t aligned in their vision, or if processes aren’t in place to ensure cohesive action, the project can crumble before it even begins.

In much the same way, the transformation of a data architecture demands not just technological reshuffling but profound shifts in organizational culture. Changing how data is managed, processed, and valued means realigning how teams think about and interact with data. It means challenging established norms and embracing new methodologies. Such transitions are never merely technical; they are deeply human.

Central to this human element is delineating roles. Who does what? Who shoulders the responsibility for ensuring that data flows smoothly, that it is processed correctly, and that it is used ethically and effectively? ...