January 2026
Intermediate
404 pages
7h 22m
Korean
Content preview from AI 에이전트 엔지니어링
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.
265
9
장
검증 및 측정
검증 및 측정
9
CHAPTER
제품과 애플리케이션을 구축하기는 그 어느 때보다 쉬워졌지만, 이러한 시스템을 효과적으로
측정하는 일은 여전히 거대한 과제입니다. 팀은 종종 빠르게 배포해야 한다는 압박을 받지만,
시간을 들여 성능을 엄격하게 평가하고 품질을 확인하면 장기적으로 이득이 되며 궁극적으로
팀이 더 확신을 가지고 빠르게 움직일 수 있습니다. 엄격한 평가와 측정이 없다면 변경 사항을
배포할지 결정하기가 훨씬 어려워집니다. 엄격한 측정과 검증은 성능 최적화뿐만 아니라 신뢰
를 구축하고 사용자 기대치에 확실히 부합하는 데 필수입니다.
이 장에서는 에이전트 기반 시스템을 평가하는 방법론을 살펴보며 주요 원칙, 측정 기법, 검증
전략을 다룹니다. 명확한 목표 정의, 적절한 지표 선정, 실제 환경에서의 시스템 성능 평가를
위한 견고한 테스트 프레임워크 구현의 중요성을 알아봅니다. 단순한 기능을 넘어 정확성, 일
관성
consistency
, 개연성
coherence
, 반응성을 포함한 에이전트 출력의 신뢰성
reliability
은 체계적인 정밀
조사가 필요합니다. 특히 이러한 시스템을 구동하는 파운데이션 모델의 확률적 특성을 고려하
면 더욱 그렇습니다.
이 장 전반에 걸쳐 전자상거래의 일반적인 시나리오를 처리하는 고객 지원 에이전트를 예로 듭
니다. ...
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.
Read now
Unlock full access
More than 5,000 organizations count on O’Reilly
O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.Julian F.
I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.Addison B.
I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.Amir M.
I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.