October 2025
Intermediate
424 pages
10h 19m
Korean
Content preview from 실무로 통하는 LLM 애플리케이션 설계
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.
388
3
부
LLM 애플리케이션 활용 패러다임
표준 접근법은 모든 내용이나 컨텍스트 윈도에 들어갈 만큼의 내용을 채워 넣는 것입니다. 대
안으로는 검색된 각 문서/요약/노트를 입력에 프리픽스로 붙여서
LLM
에 별도로 입력한 다음
출력을 결합하는 방법이 있습니다.
리우
Liu
연구진
35
은 언어 모델이 중간 부분보다 컨텍스트 윈도의 시작과 끝에 있는 정보를 더
잘 기억한다는 것을 밝혔습니다. 이를 활용해 프롬프트에서 검색된 문서들을 재정렬할 수 있
습니다.
주어진 질의에 대해
10
개의 문서를 검색했다고 가정해 보겠습니다. 문서들은 관련성에 따라
정렬됩니다(
Doc1
,
Doc2
, …
Doc10
). 이제 이러한 문서를 프롬프트에 다음 순서로 배치할
수 있습니다.
Doc1
,
Doc3
,
Doc5
,
Doc7
,
Doc9
,
Doc10
,
Doc8
,
Doc6
,
Doc4
,
Doc2
즉, 덜 관련 있는 문서들이 컨텍스트 윈도의 중간에 배치되어 모델이 무시할 가능성이 높아지
게 됩니다. 이는 현재의 긴 컨텍스트 기억 한계를 고려한 전략입니다.
다른 접근 방식으로는 문서를 관련도 순서대로 나열하는 방법이 있습니다. 예를 들어 다음 순
서로 배치할 수 있습니다.
Doc1
,
Doc2
,
Doc3
,
Doc4
,
Doc5
,
Doc6
,
Doc7
,
Doc8
,
Doc9
,
Doc10
혹은 관련도의 역순으로 정렬하는 ...
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.
Read now
Unlock full access
More than 5,000 organizations count on O’Reilly
O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.Julian F.
I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.Addison B.
I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.Amir M.
I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.