April 2026
Intermediate
592 pages
13h 28m
Korean
Content preview from 에이전트 시대의 AI 시스템 설계
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.
39
1
장
서론
1.2.6
여러 기초 모델의 지형도
지난 몇 년 동안 생성형
AI
기초 모델 생태계
ecosystem
가 크게 발전했으며, 용도나 목적에 따라
모델들을 분류하는 범주들도 점차 뚜렷해졌다.
수많은 모델을 어떻게 평가하고 선택할까? 학술적 벤치마크는 포화 상태에 이르렀고 조작 가
능성도 크다. 그래서 현재 가장 널리 인정받는 생성형
AI
모델 평가 방식은 블라인드 테스
트에서 모델들을 쌍으로 비교하는 것이다. 대규모 비교를 수행하는 프로젝트로
LMArena
(
https
://
lmarena
.
ai
)가 있다. [그림
1
-
3
]은
LMArena
의
2025
년
4
월 리더보드다.
저지연 소규모 언어 모델들
가성비 최고
가성비 중간
프런티어 모델들
그림
1-3
2025
년
4
월
6
일 기준
LMArena
리더보드(주석과 둥근 테두리는 저자들이 추가함)
리더보드의
y
축은 모델 평점,
x
축은 비용을 나타낸다.
x
축을 기준으로 삼으면 주어진 예산
에 맞는 최고의 모델을 결정할 수 있고, 반대로
y
축을 기준으로 삼으면 특정한 평점을 얻기 위
해 기대해야 할 최저 가격을 파악할 수 있다.
y
축의 엘로
Elo
점수
19
와
x
축의 비용 둘 다 로그 축
19
옮긴이_ 엘로 점수 혹은 엘로 평점 시스템은 헝가리계 미국인 물리학자 아르파드 엘로(
Arpad
Elo
)가 개발한 상대 평가 시스템으로, ...
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.
Read now
Unlock full access
More than 5,000 organizations count on O’Reilly
O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.Julian F.
I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.Addison B.
I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.Amir M.
I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.