April 2026
Intermediate
592 pages
13h 28m
Korean
Content preview from 에이전트 시대의 AI 시스템 설계
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.
465
8
장
제약 조건 해결
입력:
“솜씨 좋은 요리사가”
초안 모델
(작고 빠름)
출력:
“솜씨 좋은 요리사가 저녁으로 맛있는
봉골레를 만들었다”
저녁으로
저녁으로
저녁으로
파스타를
파스타를
봉골레를
맛있는
맛있는
맛있는
만들었다
만들었다
만들었다
작은 모델이 생성한 토큰들(빠름)
큰 모델이 검증한 토큰들(빠름)
기각된 토큰을 재생한다(느림)
대상 모델
(크고 정확함, 검증은 빠르지만 생성은 느림)
그림
8-3
추측 디코딩의 순전파 과정에서 두 모델이 함께 작동한다. 더 큰 모델이 더 작은 모델 출력의 상당 부분을 검
증하고 수락한다.
다음은 일련의 토큰에 대해 추측 디코딩이 진행되는 방식을 보여 주는 예이다.
466
에이전트 시대의 AI 시스템 설계
단계 1:
학생: "[솜씨] [좋은] [요리사가]"
교사: ✓ 수락 (일반적인 문구)
단계 2:
학생: "[저녁으로] [맛있는]"
교사: ✓ 수락 (일반적인 음식 맥락)
단계 3:
학생: "[파스타를]"
교사: ✗ 기각
교사의 토큰: "봉골레를" (드물고 구체적인 단어)
단계 4:
학생: "[만들었다]"
교사: ✓ 수락 (일반적인 마무리)
추측 디코딩이 인퍼런스 속도를 높이는 것은 ...
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.
Read now
Unlock full access
More than 5,000 organizations count on O’Reilly
O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.Julian F.
I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.Addison B.
I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.Amir M.
I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.