April 2026
Intermediate
592 pages
13h 28m
Korean
Content preview from 에이전트 시대의 AI 시스템 설계
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.
508
에이전트 시대의 AI 시스템 설계
8.4.4
참고문헌
vLLM
프레임워크에서 개발한
PagedAttention
알고리즘 및 관련 연구 덕분에
LLM
서빙
인프라의 효율성이 크게 개선되었다. 이 알고리즘은 권
Kwon
등의 논문 「
Efficient
Memory
Management
for
Large
Language
Model
Serving
with
PagedAttention
」(
2023
,
https
://
arxiv
.
org
/
abs
/
2309
.
06180
)에 자세히 설명되어 있다.
8.5
패턴
28
: 장기 기억
장기 기억
Long
-
Term
Memory
패턴은 모델이 오랜 기간에 걸친 사용자 상호작용 전반에서 정보를 유
지할 수 있게 해 준다. 이번 절에서 자세히 설명할 작업 기억, 일화 기억, 절차 기억, 의미 기억
은
LLM
기반 애플리케이션의 여러 공통 기능을 구현하는 데 꼭 필요한 요소들이다.
8.5.1
문제
LLM
은 주어진 프롬프트를 그대로 처리할 뿐이다.
LLM
자체에는 상호작용 과정에서 이전의
맥락 정보를 유지하는 능력이 없다. 하지만
LLM
기반
애플리케이션
은 어떤 형태로든 이전 상
호작용에서 얻은 정보를 기억할 필요가 있다. 챗봇이나 가상 비서 같은 애플리케이션은 사용자
의 선호도
preference
를 기억해야 한다. 사용자가 같은 말을 여러 번 반복해야 한다면 짜증을 낼 것
이므로, 세션과 세션 사이에서 대화 내역과 맥락 상태를 유지해야 한다. 클로드 코드 같은 코딩
보조 도구는 여러 파일과 세션에 걸쳐 프로젝트 구조와 의존성, 코딩 ...
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.
Read now
Unlock full access
More than 5,000 organizations count on O’Reilly
O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.Julian F.
I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.Addison B.
I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.Amir M.
I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.