April 2026
Intermediate
592 pages
13h 28m
Korean
Content preview from 에이전트 시대의 AI 시스템 설계
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.
536
에이전트 시대의 AI 시스템 설계
9.2.5
참고문헌
조립 후 재구성은
2024
년 발리아파 락슈마난이 생성형
AI
애플리케이션의 창의성과 위험의
균형에 관한 기사 (
https
://
oreil
.
ly
/
h5Lpl
)에서 소개했다.
9.3
패턴
31
: 자체점검
자체점검
Self
-
Check
패턴은 토큰 확률을 이용하여
LLM
응답의 환각을 감지한다. 이를 사실 관계
쿼리에 대해
LLM
이 신뢰도 낮은 답변을 내놓지 못하게 막는 안전장치로 활용할 수 있다.
9.3.1
문제
LLM
이 현실 세계나 입력 컨텍스트에 맞지 않게 부정확하거나 엉뚱한 콘텐츠를 지어내는 현상
을
환각
hallucination
이라고 한다. 본질적으로
LLM
은 통계적인 토큰 생성기라서 이런 환각이 발생
한다.
LLM
은 자신이 만들어내는 내용의 뜻을 알지 못한다. 실제 지식 없이 내놓는 답변이라서
사실과 다를 수 있다.
LLM
제공업체들은 환각을 줄이기 위해 훈련 데이터의 범위와 방법론을 계속 개선했고, 실제로
일반적인 작업과 쿼리에 대한 환각률이 꾸준히 감소했다. [그림
9
-
3
]은 벡타라
Vectara
가 텍스트
요약 작업에 대해 상위
25
개
LLM
의 환각률을 측정한 자료 (
https
://
oreil
.
ly
/
52Bx0
)에
기반한 그래프이다.
2024
년
12
월 기준으로 최상급
LLM
은
1
.
3
%,
25
위 모델은
4
.
1
%의 환각률
을 보였다. 벡타라가
2025
년
4
월에 같은 작업과 측도로 다시 테스트했을 때 환각률은 전반적
으로
40
%에서
50
%가량 떨어졌다. 최상급
LLM
의 환각률은
0
.
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.
Read now
Unlock full access
More than 5,000 organizations count on O’Reilly
O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.Julian F.
I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.Addison B.
I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.Amir M.
I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.