March 2026
Intermediate
504 pages
11h 26m
Korean
Content preview from 파이토치로 배우는 LLM & AI
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.
254
1
부
모델 구축
8.7
문자 기반 인코딩
지난 몇 개의 장에서 단어 기반 인코딩을 사용한 자연어 처리 작업을 알아보았습니다. 시작하
기에는 이 방법 좋지만 텍스트를 생성할 때는 문자 기반 인코딩을 고려할 수 있습니다. 말뭉치
에 있는 고유한 문자의 개수가 고유한 단어의 개수보다 훨씬 적기 때문입니다. 따라서 출력 층
에 훨씬 적은 뉴런을 둘 수 있고 출력 예측이 적은 개수의 확률로 나누어집니다. 예를 들어 셰
익스피어 데이터셋(
https
://
oreil
.
ly
/
XW
_
ab
)에는 고유한 문자가
65
개뿐입니다. 기본적으
로 셰익스피어는 대문자, 소문자 및 일부 구두점만 사용해
65
개의 고유 문자 집합을 만들었습
니다.
따라서 예측을 만들 때 아일랜드 노래 데이터셋에 있는
2
,
700
개 단어에서 다음 단어를 고르는
것이 아니라
65
개만 보면 됩니다. 모델이 조금 더 간단해지는군요!
문자 인코딩의 또 다른 장점은 구두점 문자도 포함된다는 것입니다. 따라서 줄 바꿈 등과 같은
문자를 예측할 수 있습니다. 예를 들어 셰익스피어 말뭉치에서 훈련한
RNN
을 사용해 <왕좌의
게임>에 이어지는 다음 텍스트를 생성했습니다.
YGRITTE
:
You
know
nothing
,
Jon
Snow
.
Good
night
,
we
’
ll
prove
those
body
’
s
servants
to
The
traitor
be
these
mine
:
So
diswarl
his
body
in
hope
in
this
resceins
,
I
cannot
judg
appeal
’
t
.
MENENIUS ...
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.
Read now
Unlock full access
More than 5,000 organizations count on O’Reilly
O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.Julian F.
I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.Addison B.
I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.Amir M.
I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.