June 2025
Beginner to intermediate
484 pages
10h 52m
Korean
Content preview from 잘되는 머신러닝 팀엔 이유가 있다
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.
227
Chapter 6
자동 테스트: ML 모델 테스트
이전 장에서는
ML
솔루션에서 자동 테스트가 없을 때 지불해야 하는 대가와 테스트를 통해
팀이 얻을 수 있는 품질, 흐름, 인지 부하, 만족도 측면의 이점을 살펴봤습니다. 또한 포괄적
인 테스트 전략의 구성 요소를 그려보고 그중 첫 번째 범주의 테스트인 소프트웨어 테스트에
대한 세부 사항도 다루었습니다.
이 장에서는 다음 범주의 테스트인
ML
모델 테스트를 탐구할 것입니다. 대규모 언어 모델
(
LLM
)
이 세계를 강타함에 따라
LLM
과
LLM
애플리케이션을 테스트하기 위한 기법도 다룰
것입니다.
그리고 시각화 및 오류 분석, 데이터 수집 루프 닫기, 개방형-폐쇄형 테스트 설계와 같은
ML
모델 테스트를 보완하는 방법을 탐구할 것입니다. 데이터 테스트에 대해서도 간단히 논의한
후, 이러한 테스트를
ML
시스템에 구현할 수 있는 구체적인 단계로 마무리할 것입니다.
이 장에서는 대규모의 오프라인 테스트에 초점을 맞출 것이며, 온라인 테스트 기법
(
A
/
B
테스트, 밴딧, 인터리빙 실험)
은 칩 후옌
Chip
Huyen
의 훌륭한 책 『머신러닝 시스템 설계』
(한빛미
디어,
2023
)
에서 잘 다루고 있으므로 해당 내용이 궁금하다면 이 책을 참고하세요.
자동 테스트:
ML
모델 테스트
6
CHAPTER
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.
Read now
Unlock full access
More than 5,000 organizations count on O’Reilly
O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.Julian F.
I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.Addison B.
I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.Amir M.
I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.