April 2026
Intermediate
592 pages
13h 28m
Korean
Content preview from 에이전트 시대의 AI 시스템 설계
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.
69
2
장
콘텐츠 스타일의 제어
하며, 평균 지연시간은
10
% 증가한다. 반면에 생성 실패율이
70
%라면 성공률은
30
%에 불과하므
로 평균적으로
100
/
30
, 즉
3
.
3
회의 시도가 필요하고 평균 지연시간은
230
%나 증가한다. 만약 서
버 과부하를 피하기 위해 시도 사이의 시간을 늘리는 지수적 백오프
exponential
backoff
방법을 사용하면
지연시간 증가는 훨씬 더 커진다.
•
지연시간의
99
번째 백분위수에 대한 닫힌 공식
closed
formula
4
은 없다. 대신 기하 분포를 이용해 수치
적으로 추정해야 한다.
eStat
(
https://oreil.ly/CoIOk
)의 온라인 계산기를 이용해서 추정치를
찾아볼 수 있는데, 성공률이
90
%인 예라면
p
값에
0
.
9
를 입력하고
P
(
X
<
=
x
)에서
0
.
99
를 찾으면
된다. 시도 횟수의
99
번째 백분위수는
p
=
90
일 때
2
회이지만,
p
=
30
이면 무려
13
회나 된다!
결론적으로 ‘될 때까지 재시도’ 방식은
LLM
호출 성공률이 매우 높을 때만 허용해야 한다.
생성된 텍스트가 규칙 집합을 따르도록 만드는 더 나은 방법은 로짓 마스킹 패턴을 사용하는
것이다.
2.1.2
해법
제
1
장의 “빔 탐색” 절에서 논의했듯이, 기초 모델은 현재까지 만들어진 텍스트 다음에 나올 수
있는 후속 시퀀스를 적절한 확률분포에 따라 ...
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.
Read now
Unlock full access
More than 5,000 organizations count on O’Reilly
O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.Julian F.
I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.Addison B.
I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.Amir M.
I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.