April 2026
Intermediate
592 pages
13h 28m
Korean
Content preview from 에이전트 시대의 AI 시스템 설계
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.
452
에이전트 시대의 AI 시스템 설계
8.1
패턴
24
: 소규모 언어 모델
소규모 언어 모델
Small
Language
Model
패턴, 줄여서
SLM
패턴은 품질을 크게 훼손하지 않으면서도
비용 및 지연시간 제약 조건에 더 잘 맞는 작은 모델을 사용할 수 있게 하는 기술들의 집합이
다.
증류
distillation
는 모델의 지식 범위를 좁혀 크기를 줄이고,
양자화
quantization
는 모델 매개변수의
정밀도를 낮추어 메모리 소비를 줄이며,
추측 디코딩
speculative
decoding
은 작은 모델을 사용해 토큰
을 생성하고 큰 모델로 이를 검증한다.
8.1.1
문제
프런티어 모델을 자체 하드웨어에서 실행하려면
RAM
이 아주 넉넉한 최신
GPU
와
VM
(가상
머신 )이 필요하다. 하이퍼스케일러 (
AWS
,
MS
애저,
GCP
,
OCI
등) 기반 인프라를 이용하면
그런 하드웨어가 필요하지 않지만, 대신 클라우드 비용이 증가할 뿐만 아니라 해당 제공업체의
장애나 자원 부족으로 인한 가용성
availability
문제에서 벗어날 수 없다. 이 글을 쓰는 시점에도 하
이퍼스케일러의 하드웨어 자원이 부족해 장애가 발생하곤 한다. 제공업체의
API
를 통해 프런
티어 모델을 호출한다면 여러분이 직접 인퍼런스 인프라를 운영할 필요는 없지만, 그런다고 해
도 비용과 가용성 문제가 완전히 사라지지는 않는다. 메모리 관리와 자원 부족 문제를 사용자
가 직접 겪지 않을 뿐, 제공업체가 대신 겪게 되는 것이다.
단순함을 위해 이번 절에서는
LLM
을 로컬에서 ...
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.
Read now
Unlock full access
More than 5,000 organizations count on O’Reilly
O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.Julian F.
I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.Addison B.
I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.Amir M.
I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.