CHAPTER 12Trust Under Uncertainty
The most damaging failures in the agent era rarely emerge from a single isolated mistake. They compound over time as organizations optimize aggressively for speed, efficiency, or short-term margin while weakening the conditions that make trust, resilience, and controlled adaptation possible. By the time the damage becomes visible, the loss rarely stops at reputation. Organizations lose optionality, resilience, and eventually the organizational confidence required to keep deploying autonomy at scale.
These failures often begin before any public incident, when organizations modernize the technology faster than they modernize the culture around verification, escalation, and accountability. In agentic environments, culture is not a soft backdrop. It determines whether people question outputs, surface weak signals, challenge automated momentum, and preserve trust before efficiency gains and optimization pressure quietly become overreach.
Many organizations still treat trust as a communications concern to be managed after something goes wrong. In environments shaped by autonomous systems, that framing breaks down because trust now functions as operational infrastructure. It determines whether customers remain loyal during disruption, whether partners are willing to integrate deeply, whether regulators allow experimentation, whether investors remain patient, and whether innovation survives its first serious failure. Responsibility therefore becomes ...
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.
Read now
Unlock full access