March 2026
Intermediate
504 pages
11h 26m
Korean
Content preview from 파이토치로 배우는 LLM & AI
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.
225
7
장
자연어 처리를 위한 순환 신경망
추가 분석을 위해 어휘 사전을 고려해야 합니다. 과대적합을 피하기 위해 이전 장에서 수행했
던 최적화 방법 중 하나는 자주 등장하지 않는 단어로 임베딩에 과부하를 주지 않도록 하는 것
이었습니다. 즉 자주 등장하는 단어로 구성된 작은 어휘 사전으로 과대적합을 피했습니다. 이
번 예제는 단어 임베딩이 이미
GloVe
로 학습된 것이므로 어휘 사전을 확장할 수 있습니다. 하
지만 얼마나 많이 확장할 수 있을까요?
우선 말뭉치에 있는 단어 중 얼마나 많은 단어가
GloVe
벡터에 있는지 살펴봐야 합니다.
GloVe
에는
120
만 개 단어가 있지만 현재 말뭉치에 있는 모든 단어가 들어 있다는 보장은 없
습니다.
word
_
index
를 구축할 때 매우 큰 숫자로
build
_
vocab
_
glove
를 호출할 수 있습니다. 총량을
초과하는 단어는 무시됩니다. 예를 들어 다음과 같이 호출한다고 가정해 보죠.
word_index = build_vocab_glove(training_sentences, max_vocab_size=100,000)
Sarcasm
데이터셋의 경우
22
,
457
크기의
word
_
index
가 반환됩니다. 필요하다면 이 단어들
중 실제로
GloVe
임베딩에 존재하는 단어가 얼마나 되는지 확인할 수 있습니다. 먼저 임베딩
을
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.
Read now
Unlock full access
More than 5,000 organizations count on O’Reilly
O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.Julian F.
I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.Addison B.
I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.Amir M.
I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.