December 2024
Beginner to intermediate
320 pages
7h 25m
Korean
Content preview from GPT API를 활용한 인공지능 앱 개발(2판)
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.
24
GPT API를 활용한 인공지능 앱 개발(2판)
1.1.3
GPT
모델의 토큰화 및 예측 단계
GPT
등의
LLM
은 프롬프트 입력에 대한 응답으로 텍스트를 생성합니다. 이를
텍스트 완성
text
completion
이라고 합니다. 프롬프트가 ‘
The
weather
is
nice
today
,
so
I
decided
to
’라면 모델
은 ‘
go
for
a
walk
’ 같은 문구를 출력합니다.
LLM
이 입력 프롬프트에서 이 출력 텍스트를 어
떻게 작성하는지 궁금할 수 있는데, 이는 확률값을 구하는 문제입니다.
프롬프트가
LLM
으로 전송되면 먼저 입력 내용을 토큰
token
이라고 부르는 작은 조각으로 나눕
니다. 이때 단일 단어, 단어의 일부, 공백, 구두점 등을 모두 토큰으로 나타냅니다. 각 언어 모
델에는 자체 토큰화 도구가 함께 제공됩니다.
GPT
모델별 토크나이저(
https
://
oreil
.
ly
/
hbKT7
)는 오픈
AI
웹사이트에서 테스트할 수 있습니다. 예를 들어
GPT
-
4o
토크나이저는 앞
서 제시된 프롬프트를
["
The
", "
weather
", "
is
", "
nice
", "
today
", ",", "
so
",
"
I
", "
decided
", "
to
"]
로 분해합니다.
TIP
오픈
AI
에 따르면 영단어 약
75
개를 변환하면
100
토큰이 됩니다.
어텐션 원리와 트랜스포머 아키텍처 ...
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.
Read now
Unlock full access
More than 5,000 organizations count on O’Reilly
O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.Julian F.
I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.Addison B.
I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.Amir M.
I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.