10
AgentOps and EvalOps
This chapter moves from persistence to operations. Once agents can retain state and explain past decisions, the next architectural question is whether they remain trustworthy while running, how their behavior is evaluated continuously, and who has the authority to intervene when they drift.
In the previous chapter, we resolved the question of how agents persist what they decide and how to prove it after the fact. This chapter takes the next step: persistence is the evidence; AgentOps and EvalOps are the disciplines that decide whether the agent should keep deciding at all.
Persistence without oversight is a liability. DevOps manages infrastructure and code. AgentOps manages the uncertainty of goal-directed systems that ...
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.
Read now
Unlock full access