March 2026
Intermediate
504 pages
11h 26m
Korean
Content preview from 파이토치로 배우는 LLM & AI
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.
425
17
장
Ollama로 LLM 서빙하기
Ollama
로
LLM
서빙하기
CHAPTER
17
transformers
로 모델을 다운로드하고 추론이나 미세 튜닝에 사용하는 파이프라인을 구성하
는 방법을 살펴봤습니다. 하지만 오픈 소스
Ollama
프로젝트를 소개하지 않을 수 없습니다.
Ollama
는
LLM
을 완전히 감싸는 환경을 제공하며 이를 통해 터미널에서 모델과 채팅을 수행
하거나
HTTP
POST
로 데이터를 보내고 출력을 받는 서버로 사용할 수 있습니다.
Ollama
와 같은 기술은 차세대
LLM
의 선봉이 될 것입니다. 이를 통해 데이터 센터에 전용 서
버를 두거나 컴퓨터에 전용 프로세스를 띄울 수 있습니다. 따라서 완전히 비공개로 사용할 수
있습니다.
핵심적으로
Ollama
는 컴퓨터에
LLM
다운로드, 실행, 관리 과정을 단순화해 주는 오픈 소스
프로젝트입니다. 또한 메모리 관리와 모델 최적화 같은 기능에 관련이 없지만 어려운 요구 사
항을 처리해 줍니다.
HTTP
POST
로 모델과 통신하는 것처럼 상호 작용을 위한 표준화된 인
터페이스를 제공합니다.
Ollama
는 챗
GPT
, 클로드
Claude
, 제미나이
Gemini
와 같은 클라우드 기반 서드 파티 서비스와 로
컬 배포 서비스 사이의 간극을 메우기 때문에 우리가 고려해야 할 핵심 전략 도구입니다. 단순
히 로컬 개발 ...
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.
Read now
Unlock full access
More than 5,000 organizations count on O’Reilly
O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.Julian F.
I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.Addison B.
I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.Amir M.
I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.