April 2026
Intermediate
348 pages
8h 22m
Korean
Content preview from 그림으로 배우는 생성형 AI
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.
256
그림으로 배우는 생성형 AI
5.1.1 모델 간 직접 비교
모델 제공업체가 자사 모델의 지표와 벤치마크 데이
터셋을 자신에게 유리하게 조작하는 경우가 종종 있
습니다
.
그래서 여러 모델의 품질을 비교할 때는 블
라인드 테스트
blind
test
를 사용하는 것이 바람직한데
요
.
맹검이라고 하는 블라인드 테스트는 간단하게 말
하면 사람에게 두
LLM
의 응답을 보여주고 어느 쪽이
더 나은지 선택하게 하는 것입니다
.
이 방식을 대규
모로
,
공개적이고 투명하게 운영하는
LMSYS
Large
Model
Systems
(
https://lmsys.org
)
라는 연구 조직이 있습니
다
.
LMSYS
는 입력 프롬프트
,
출력 응답
,
그리고 쌍
별 비교에 대한 사람의 선호도가 모두 포함된 비교 결
과를 공개합니다
.
그림
5 - 3
특정
LLM
에 종속되지 않는
LLM
비종속적 구현이 가능하긴 하지만 쉬운 일은 아닙니다.
앱을 LLM
비종속적으로 구현했으니
어떤 모델을 사용해도
잘 작동할 거야!
모델 A에서
모델 B로
전환하자.
왜 다 엉망이
된 거지?
사전 공지: LLM에 따라 결과가
매우 다를 수 있음!
새로운 팀 우선순위
모델 교체 후
LLM 비종속적(Agnostic)
**
LLM 비종속적 코드가 해결책이 될까? 글쎄...
기초 모델 선택
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.
Read now
Unlock full access
More than 5,000 organizations count on O’Reilly
O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.Julian F.
I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.Addison B.
I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.Amir M.
I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.