March 2026
Intermediate
504 pages
11h 26m
Korean
Content preview from 파이토치로 배우는 LLM & AI
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.
229
8
장
머신러닝으로 텍스트 생성하기
머신러닝으로 텍스트 생성하기
CHAPTER
8
2022
년 챗
GPT
가 출시되면서
생성형
AI
라는 표현이 일반적인 용어로 자리잡았습니다. 클라우
드 기반
AI
와 대화할 수 있도록 하는 이 간단한 애플리케이션은 인간의 경험 전반에 걸친 방대
한 지식을 바탕으로 질문에 답변한다는 점에서 거의 기적처럼 보였습니다. 이는 이전 장에서
본 순환 신경망을 넘어선,
트랜스포머
transformer
라는 기술을 활용해 구현된 것입니다.
트랜스포머는 한 텍스트를 다른 텍스트로 변환하는 패턴을 학습합니다. 충분히 큰 트랜스포
머 아키텍처와 학습에 사용할 수 있는 충분한 양의 텍스트가 주어지면,
GPT
모델 (
GPT
는
generative
pretrained
transformer
의 약자)은 주어진 텍스트 뒤에 이어질 다음 토큰을 예
측할 수 있습니다. 이러한
GPT
가 사용자 친화적인 애플리케이션 형태로 제공되면서, 완전히
새로운 산업이 탄생했습니다.
트랜스포머로 모델을 직접 만드는 것은 이 책의 범위를 벗어나지만,
15
장에서 그 아키텍처를
자세히 살펴볼 예정입니다.
트랜스포머로 모델을 훈련하는 데 적용되는 원칙은
RNN
이나
LSTM
과 같은 더 작고 단순한 아
키텍처에도 그대로 적용할 수 있습니다. 이 장에서는 전통 아일랜드 노래로 구성된 훨씬 작은
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.
Read now
Unlock full access
More than 5,000 organizations count on O’Reilly
O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.Julian F.
I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.Addison B.
I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.Amir M.
I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.