March 2026
Intermediate
504 pages
11h 26m
Korean
Content preview from 파이토치로 배우는 LLM & AI
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.
405
16
장
사용자 정의 데이터와 함께 LLM 사용하기
logging_dir='./logs',
logging_steps=500,
evaluation_strategy="epoch",
save_strategy="epoch",
load_best_model_at_end=True,
metric_for_best_model="accuracy",
push_to_hub=False,
gradient_accumulation_steps=4,
gradient_checkpointing=True,
report_to="none",
fp16=True
)
하이퍼파라미터를 조정하면 다른 결과를 얻을 수 있습니다. 옵티마이저에 대해 앞서 언급한 것
외에도 배치 크기를 고려해야 합니다. 훈련이나 평가에 다른 배치 크기를 지정할 수 있습니다.
매우 유용한 매개변수 중 하나는 (여기에서처럼
3
번 에폭보다 길게 훈련하는 경우 )
load
_
best
_
model
_
at
_
end
입니다. 마지막 체크포인트를 사용하는 것이 아니라 지정된 메트릭 (이 경
우 정확도 )에 따라 최상의 체크포인트를 추적하여 훈련이 완료된 후 해당 체크포인트를 로드
합니다.
evaluation
_
strategy
와
save
_
strategy
를
epoch
으로 설정했기 때문에 에폭이 끝
날 때마다 해당 작업을 수행합니다. ...
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.
Read now
Unlock full access
More than 5,000 organizations count on O’Reilly
O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.Julian F.
I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.Addison B.
I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.Amir M.
I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.