April 2026
Intermediate
592 pages
13h 28m
Korean
Content preview from 에이전트 시대의 AI 시스템 설계
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.
577
10
장
조합 가능한 에이전트형 작업흐름
에이전트가 제시한 키워드들이 얼마나 훌륭한지 평가하려면 키워드들을 기록해 두어야 한다.
로그 기록은 초안이 생성될 때마다 이루어진다. 에이전트들은 다음과 같은 코드를 통해서 입력
과 출력을 기록해 둔다.
from composable_app.utils import save_for_eval as evals
...
evals.record_ai_response("initial draft",
ai_input=prompt_vars,
ai_response=initial_draft)
이렇게 생성된 로그를 이용해서 오프라인 평가를 수행하는 예가
evals
/
evaluate
_
keywords
.
py
에 있으니 참고하기 바란다.
어떤 활동의 결과가 얼마나 좋은지는 며칠이 지나서야 알게 되는 경우가 많다. 따라서 작업흐
름의 단계들을 한데 묶어서 결과와 비교하고 비즈니스와 유관한 평가 지표를 도출할 수 있어야
한다. 이번 장에서 살펴본 교육 콘텐츠 제작 시나리오라면, 매력도 (해당 주제를 수업 계획에
포함하는 교사의 수 등 ), 참여도 (끝까지 읽은 학생의 수 등 ) 그리고 실제 성적 (해당 주제에 대
한 국가시험 질문에 올바르게 답한 학생의 비율 등 ) 같은 지표가 유용할 것이다.
인간 피드백과 오프라인 평가는
콘텐츠 최적화 ...
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.
Read now
Unlock full access
More than 5,000 organizations count on O’Reilly
O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.Julian F.
I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.Addison B.
I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.Amir M.
I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.