March 2026
Intermediate
504 pages
11h 26m
Korean
Content preview from 파이토치로 배우는 LLM & AI
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.
171
6
장
임베딩을 사용한 감성 프로그래밍
6.2
파이토치의 임베딩
Linear
와
Conv2d
처럼 파이토치는 층을 사용해 임베딩을 구현합니다. 이 층은 정수를 임베딩
벡터로 매핑하는 룩업 테이블
lookup
table
을 만듭니다. 이 테이블은 정수로 표현된 단어의 벡터를
담고 있습니다. 이전 절의 『오만과 편견』 예에서는
x
와
y
축이 등장인물에 대한 임베딩을 형성
합니다. 실제 자연어 처리 문제에서는 두 개보다 훨씬 많은 차원을 사용합니다. 따라서 벡터 공
간에 있는 한 벡터의 방향이 단어의 의미를 인코딩한다고 볼 수 있습니다. 비슷한 (즉, 거의 비
슷한 방향을 가리키는 ) 벡터를 가진 단어들은 서로 연관된다고 볼 수 있습니다.
임베딩 층은 초기에 랜덤하게 초기화됩니다. 즉 시작할 때 벡터의 좌표가 완전히 랜덤하게 설
정되고 훈련 과정에서 역전파를 사용해 학습합니다. 훈련이 끝나면 임베딩은 단어 사이의 유사
성을 인코딩하기 때문에 단어의 벡터 방향 기반으로 비슷한 단어를 식별합니다.
설명이 추상적이라 이해하기 어렵다면 직접 만들어 보며 임베딩의 사용 방법을 이해해 봅시다.
5
장의
Sarcasm
데이터셋으로 빈정대는 헤드라인 감지기를 만들어 보겠습니다.
6.2.1
임베딩을 사용해 빈정거림 감지기 만들기
5
장에서
News
Headlines
Dataset
for
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.
Read now
Unlock full access
More than 5,000 organizations count on O’Reilly
O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.Julian F.
I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.Addison B.
I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.Amir M.
I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.