model=job_status.fine_tuned_model, # 미세조정된 모델을 사용한다.
messages=messages
)
print(completion.choices[0].message.content)
1.6.3
가중치 공개 모델의 미세조정
언슬로스
Unsloth
(
http
://
Unsloth
.
ai
)는 젬마나 라마 같은 가중치 공개
LLM
을 미세조정하고
훈련하는 기능을 제공한다. 언슬로스로 모델을 미세조정하는 방법은 크게 두 가지이다. 하나는
여러분의 로컬 하드웨어에서 언슬로스를 직접 실행하는 것이고 다른 하나는 언슬로스
AI
가 제
공하는 관리형 미세조정 서비스를 이용하는 것이다. 여기서는 전자를 소개한다.
라마
3
의
4
비트 양자화 버전을 로컬에서 미세조정해 보자. 먼저 할 일은 해당 모델과
토크나이
저
tokenizer
를 불러오는 ...
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month, and much more.
O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.
Julian F.
Head of Cybersecurity
I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.
Addison B.
Field Engineer
I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.
Amir M.
Data Platform Tech Lead
I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.