January 2026
Intermediate
404 pages
7h 22m
Korean
Content preview from AI 에이전트 엔지니어링
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.
303
10
장
운영 환경 모니터링
10.8
분포 변화
에이전트 기반 시스템을 모니터링할 때 분포 변화를 식별하고 관리하는 건 어렵지만 결정적으
로 중요한 과제입니다. 이는 시간이 지나며 에이전트 환경의 통계적 특성이 바뀔 때 발생합니
다. 예를 들어 사용자의 언어 진화, 새로운 제품 용어,
API
응답의 변화, 심지어 파운데이션 모
델 자체의 업데이트 등이 있습니다. 이러한 변화는 명시적 에러를 일으키지 않을 수 있지만 성
능 저하, 불일치한 출력, 폴백 사용 증가로 나타나는 경우가 많습니다.
모니터링 시스템은 이렇게 느린 드리프트에 맞서는
1
차 방어선입니다. 작업 성공률, 도구 호출
실패, 토큰 사용량 추세나 할루시네이션 빈도 같은 시맨틱 지표를 추적하는 대시보드는 초기
신호를 드러낼 수 있습니다. 정량적 탐지를 위해서는
KS
검정
Kolmogorov
-
Smirnov
test
같은 통계 검
정을 사용해 입력 특성이나 출력의 분포를 비교합니다.
KS
검정은 두 데이터셋의 경험적 누적
분포함수 (
ECDF
)를 비교해 동일한 분포에서 나왔는지 판단하는 비모수 검정으로, 질의 길이,
지연시간, 수치 지표처럼 연속형 특성의 변화를 정규성 가정 없이 탐지하는 데 적합합니다. 분
포 간 최대 수직 거리 (
KS
통계량 )를 계산하고, 통계적 유의성을 판단하기 위한
p
값도 함께
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.
Read now
Unlock full access
More than 5,000 organizations count on O’Reilly
O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.Julian F.
I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.Addison B.
I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.Amir M.
I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.