September 2024
Beginner to intermediate
364 pages
8h 27m
Korean
Content preview from 머신러닝 인터뷰 실무 가이드
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.
140
머신러닝 인터뷰 실무 가이드
가 이 작업을 하는 데 드는 시간을 많이 절약해 줍니다.
TIP
파인 튜닝은
BERT
뿐만 아니라 다른 많은 머신러닝 모델에도 사용할 수 있습니다. 예를 들어, (이 글을
쓰는 시점 기준으로)
GPT
-
3
.
5
(
https
://
oreil
.
ly
/
5IMBU
)와 같은 모델도 파인 튜닝할 수 있습니다. 그러나
저는
BERT
와 관련된 파인 튜닝에 대한 질문을 많이 접했기 때문에, 이 주제를
BERT
와 함께 다뤘습니다.
GPT
모델 요약
GPT
Generative
Pretrained
Transformer
계열의 자연어 처리 모델은
OpenAI
의 도구인
ChatGPT
를
구동하는 것으로 잘 알려져 있습니다.
GPT
계열의 모델로는 집필 시점 기준으로
GPT
-
1
,
GPT
-
2
,
GPT
-
3
, 그리고
GPT
-
4
가 존재합니다.
37
이들은
BookCorpus
,
WebText
(레
딧), 영문 위키피디아 등과 같은 대규모 텍스트 코퍼스
38
를 이용하여 학습됩니다.
GPT
계열은 트랜스포머를 활용하며 다음 단어를 예측하도록 사전 학습됩니다. 다른 주요 자
연어 처리 모델처럼
GPT
역시 텍스트 생성과 같은 더 특정한 과업을 위해 사전 학습된 모델
의 파라미터를 업데이트하는 다운스트림 파인 튜닝
39
이 가능합니다. 특히, 이 글을 쓰고 있는
시점에서
ChatGPT
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.
Read now
Unlock full access
More than 5,000 organizations count on O’Reilly
O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.Julian F.
I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.Addison B.
I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.Amir M.
I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.