CHAPTER 2Where Current Frameworks Break Down
The most dangerous belief enterprises hold is that their existing technology, risk, and operational governance frameworks only need incremental adjustment to manage systems that act, especially agentic systems operating with delegated authority. AI is not a step forward in the linear evolution of enterprise risk management. We are moving from governance of systems to governance within systems, as control shifts from execution to delegated decision-making.
That belief in incrementalism is understandable. Organizations have spent decades building and refining cybersecurity programs, trust and safety operations, compliance regimes, enterprise risk management, and product governance. These disciplines matured through hard lessons learned from software whose behavior was largely bounded by explicit logic, infrastructure constraints, and human-initiated action. They survived the rise of the web, mobile platforms, machine learning, and successive hype cycles by adapting at the margins. What has changed is not the intent of governance, but the behavior of the systems it governs. The shift is not from certainty to uncertainty; it is from governing engineered execution to governing delegated decision-making. Some mature digital governance models can evolve to address these challenges, but most operating models were not designed for continuous delegated decision authority exercised inside production systems. The issue is not that governance ...
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.
Read now
Unlock full access