October 2025
Intermediate
424 pages
10h 19m
Korean
Content preview from 실무로 통하는 LLM 애플리케이션 설계
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.
133
4
장
아키텍처와 학습 목표
...Her father was growing nervous , and could not understand her....
...
연습 문제 ●●●
‘
nervous
’라는 단어를 한 번도 들어 본 적이 없다고 상상해 보세요. 이 단어가 사용된 다양한 맥
락만 살펴보고도 의미를 추측할 수 있을까요?
‘
nervous
’의 동의어들이 사용되는 맥락도 확인해 보세요. ‘
nervous
’가 사용되는 맥락과 얼마나
유사한가요?
4.3
트랜스포머 아키텍처
이제 텍스트가 어떻게 벡터 형태로 표현되는지에 대한 직관을 얻었으니, 오늘날 언어 모델 훈
련에 사용되는 대표적인 아키텍처인 트랜스포머를 더 깊이 살펴보겠습니다.
2010
년대 중반까지 자연어 처리 작업에 주로 사용되던 아키텍처는 순환 신경망이었으며, 특
히 장단기 메모리를 활용한
LSTM
이라는 변형이 널리 사용되었습니다. 이 책에서는 순환 신경
망에 관한 지식이 필수는 아니지만, 더 자세한 내용은 『자연어 처리를 위한 신경망 방법론
Neural
Network
Methods
for
Natural
Language
Processing
』
3
을 참고하길 권합니다.
순환 신경망은 시퀀스 모델로, 텍스트를 한 번에 하나의 토큰씩 순차적으로 처리했습니다. 전
체 시퀀스의 상태를 단일 벡터로 표현했으므로 시퀀스가
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.
Read now
Unlock full access
More than 5,000 organizations count on O’Reilly
O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.Julian F.
I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.Addison B.
I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.Amir M.
I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.