April 2026
Intermediate
592 pages
13h 28m
Korean
Content preview from 에이전트 시대의 AI 시스템 설계
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.
547
9
장
안전장치 설정
용이 서로 모순될 경우, 생성된 응답의 로그 확률을 살펴보면 가능한 생성 경로가 두 가지였음
을 알게 된다. 모델이 어느 경로를 선택했든 로그 확률을 확인하면 잠재적으로 문제가 있는 답
변을 식별할 수 있다. 물론 생성 경로가 두 가지라고 해서 반드시 충돌이 발생했다는 뜻은 아니
다. 두 경로 모두 같은 답으로 이어질 수도 있기 때문이다. 거짓 양성 오류를 줄이려면 §
9
.
3
.
2
“해법”에서 설명한 좀 더 견고한 접근법을 사용하면 된다.
제
2
장 §
2
.
1
“패턴
1
: 로짓 마스킹”의 ‘주의사항’ 절에서 논의했듯이 모든 모델이 로그 확률을 제
공하지는 않는다.
9.3.5
참고문헌
마나쿨
Manakul
, 류시
Liusie
, 게일스
Gales
는 환각 탐지에 로그 확률을 활용한다는 아이디어와
SelfCheckGP
라는 탐지기를 소개했다 (
2023
,
https
://
arxiv
.
org
/
abs
/
2303
.
08896
).
그들은 시퀀스 생성을 사용했으며 독점
LLM
이 로그 확률을 제공하지 않는 경우 로그 확률 생
성만을 위해 별도의
LLM
을 사용할 것을 제안했다. 케베도
Quevedo
등은 환각을 탐지하기 위
해
LLM
이 출력하는 토큰 확률로
ML
분류기를 훈련했다 (
2024
,
https
://
arxiv
.
org
/
abs
/
2405
.
19648v1
). 발렌틴
Valentin
등은 로그 확률을 이용해서 환각을 탐지하는 다양한 방법
을 비교했다 (
2024
,
https
://
arxiv
.
org
/
abs
/
2407
.
21424v1
).
9.4
패턴
32
: 가드레일
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.
Read now
Unlock full access
More than 5,000 organizations count on O’Reilly
O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.Julian F.
I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.Addison B.
I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.Amir M.
I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.