April 2026
Intermediate
592 pages
13h 28m
Korean
Content preview from 에이전트 시대의 AI 시스템 설계
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.
154
에이전트 시대의 AI 시스템 설계
실행해서 원래의 예시 콘텐츠를 생성하는 데 사용했던 것보다 개선된
LLM
을 얻을 수 있다. 물
론 이 과정은 어느 시점에서 포화 상태에 도달하겠지만, 이러한 메타 훈련
metatraining
을 통해 해
당 크기의
LLM
이 달성할 수 있는 품질을 매우 합리적인 비용으로 극대화할 수 있다.
프롬프트 라이브러리에 대한 훈련을 여러 번 반복하려면 더 큰 규모의 예시 라이브러리가 필요
하다. 시스템을 배포해서 한동안 운영하면서 꽤 많은 사용자 프롬프트를 기록했다면, 반복 횟
수를 늘려 보아도 좋을 것이다. 더 큰 예시 라이브러리를 확보하는 또 다른 방법은 매우 다양한
문제들과 관련된 프롬프트들로
LLM
을 훈련하는 것이다.
2025
년 초
DeepSeek
-
R1
이 그토
록 큰 성과를 거둔 것은, 사용자들이 쉽게 검증할 수 있는 문제에 해당하는 합성 데이터에 반복
적
DPO
를 적용하여 상당한 개선을 이룰 수 있다는 점을 깨달은 덕분이었다. 훈련 데이터셋을
확장하는 데 사용할 수 있고 검증이 쉬운 문제가 많다면 그런 접근법을 사용하는 것을 고려해
야 한다.
평가기
선호도 조정
훈련 데이터셋
직접 선호도
최적화(
DPO
)
조정된
LLM
LLM
훈련 1회 실행
프롬프트
라이브러리
다음 훈련 실행을
위해 대체
원했던 스타일의
콘텐츠
그림
2-14
대규모 ...
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.
Read now
Unlock full access
More than 5,000 organizations count on O’Reilly
O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.Julian F.
I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.Addison B.
I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.Amir M.
I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.