March 2026
Intermediate
504 pages
11h 26m
Korean
Content preview from 파이토치로 배우는 LLM & AI
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.
429
17
장
Ollama로 LLM 서빙하기
그림
17-3
Ollama
에서 멀티모달 모델 사용하기
개인 정보를 유지하면서 채팅할 수 있는 로컬
LLM
을 가질 수 있다는 것은 정말 멋집니다. 하지
만
Ollama
의 진정한 힘은 애플리케이션의 기반 서버로 사용하는 것입니다. 이에 대해 다음 절
에서 알아보겠습니다.
17.2
서버로
Ollama
실행하기
다음 명령으로
Ollama
를 서버 모드로 실행할 수 있습니다.
ollama serve
기본적으로
Ollama
서버는
11434
포트에서 실행됩니다.
curl
명령으로 추론을 요청할 수 있
습니다.
별도의 터미널 창에서 다음과 같이
curl
명령을 실행합니다.
curl http://localhost:11434/api/generate -d '{
"model": "gemma2:2b",
430
2
부
모델 사용
"prompt": "Why is the sky blue?",
"stream": false
}'
stream
매개변수를
true
로 설정하면
HTTP
연결이 유지된 상태로 단어별로 응답이 보내집니
다. 이렇게 하면 첫 번째 단어가 출력되기까지의 속도가 ...
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.
Read now
Unlock full access
More than 5,000 organizations count on O’Reilly
O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.Julian F.
I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.Addison B.
I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.Amir M.
I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.