October 2025
Intermediate
424 pages
10h 19m
Korean
Content preview from 실무로 통하는 LLM 애플리케이션 설계
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.
178
2
부
LLM 활용하기
이름 가용성 크기 변형
RedPajama Apache
2
.
0 3B
,
7B RedPajama
-
INCITE
-
Instruct
,
RedPajama
-
INCITE
-
Chat
GPT
-
Neo
X Apache
2
.
0 20B
-
BLOOM
공개, 제한적 사용
176B BLOOMZ
Llama
공개, 상업적 사용
불가
7B
,
13B
,
33B
,
65B
-
Llama
2
공개, 상업적 사용
가능
7B
,
13B
,
70B Llama
2
-
Chat
Zephyr Apache
2
.
0 7B
-
Gemma
공개, 제한적 사용
2B
,
7B Gemma
-
Instruction
조정
5.2
적합한
LLM
을 선택하는 방법
시중에는 정말 다양한
LLM
이 존재하는데, 이 중 어떤 모델이 내 작업에 가장 적합할까요? 상
황에 따라 고려해야 할 요소는 다양하며 대표적으로 다음과 같은 기준들을 살펴볼 수 있습
니다.
●
비용 : 여기에는 추론이나 파인 튜닝 비용부터 소프트웨어 기반 구축, 모니터링 및 관찰 가능성, 배포 및 유지
보수와 관련된 비용이 포함됩니다. 이러한 요소는 통상
LLMOps
라는 개념으로 통칭합니다.
●
출력 토큰당 시간(
TPOT
)
28
: 최종 사용자가 경험하는 텍스트 생성 속도를 측정하는 데 사용되는 지표입니다.
●
작업 성능 : 작업의 성능 요구 사항과 정밀도
precision
나 정확도 같은
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.
Read now
Unlock full access
More than 5,000 organizations count on O’Reilly
O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.Julian F.
I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.Addison B.
I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.Amir M.
I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.