October 2025
Intermediate
424 pages
10h 19m
Korean
Content preview from 실무로 통하는 LLM 애플리케이션 설계
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.
253
8
장
정렬 훈련과 추론
정렬 훈련과 추론
8
CHAPTER
LLM
의 도입을 주저하게 하는 대표적인 이유로는 환각 현상, 제한적인 추론 능력, 편향성과 안
전성 문제 등이 있습니다. 이 장에서는 이러한 한계를 살펴보고 이를 완화하는 다양한 기법을
소개합니다.
우선, 모델이 바람직한 방향으로 작동하도록 유도하는 정렬 훈련의 개념을 설명합니다.
8.1
정렬 훈련의 정의
언어 모델과 관련하여
정렬
문제
가 자주 언급됩니다. 그렇다면 이 문제는 실제로 무엇을 의미
할까요? 이상적으로는 우리가 완전히 이해하고, 통제하며, 원하는 방향으로 유도할 수 있는
언어 모델이 바람직합니다. 그러나 현재의 언어 모델은 이러한 이상에 아직 도달하지 못한 상
태입니다.
따라서 정렬의 목표는 언어 모델을 더 잘 통제하고 조정 가능하게 하는 것입니다.
앤트로픽의 애스켈
Askell
연구진
1
은 정렬된
AI
를 ‘도움이 되고
helpful
, 정직하며
honest
, 해롭지 않
은
harmless
존재’로 정의합니다. 이들은 이를
3H
원칙으로 요약하며 다음과 같이 설명합니다.
1
Askell
et
al
., “
A
General
Language
Assistant
as
a
Laboratory
for
Alignment
”,
9
Dec
2021
,
https
://
arxiv
.
org
/
abs
/
2112
.
00861 ...
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.
Read now
Unlock full access
More than 5,000 organizations count on O’Reilly
O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.Julian F.
I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.Addison B.
I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.Amir M.
I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.