June 2025
Beginner to intermediate
484 pages
10h 52m
Korean
Content preview from 잘되는 머신러닝 팀엔 이유가 있다
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.
233
Chapter 6
자동 테스트: ML 모델 테스트
ML
분야로 돌아와서, 어떤 도메인
( 이탈 예측, 제품 추천 등 )
에서
ML
을 사용하든 좋고 나
쁨을 측정할 척도를 세울 수 있습니다. 그리고 알다시피
ML
은
loss
로 만들어진 척도를 줄여
나가도록 끊임없이 내부 파라미터가 수렴하면서 성능이 개선되도록 합니다. 심지어 더 추상
적인
ML
사례
(
LLM
기반의 이력서 생성)
에서는 사용자들이 모델의 예측이 얼마나 부합하
는지 여부나 품질에 대한 의견을 내기도 합니다
(이 장의 뒷부분에서 이러한 척도를 어떻게 적합
도 함수 형태로 정의하는지를 알아봅니다)
.
예를 들어,
ML
모델을 위한 몇 가지 적합도 함수는 다음과 같습니다.
지표 기반 테스트
테스트 데이터를 이용하여 주어진 평가 지표를 계산했을 때 지정된 임곗값 이상이면 모
델을 릴리스할 수 있습니다.
모델 형평성 테스트
각 주요 세그먼트
( 국가 )
별로 평가 지표를 계산했을 때, 서로
X
% 이내인 경우에는 모
델을 릴리스할 수 있습니다.
모델
API
지연 시간 테스트
모델이
t
초 이내에
N
개의 동시 요청을 처리할 수 있는 경우에는 모델을 릴리스할 수 있
습니다.
모델 크기 테스트
모델 아티팩트가 정해진 크기 이하인지를 테스트하여 임베디드 장치나 모바일 장치에
배포할 수 있는지 확인합니다.
훈련 기간 테스트
모델 훈련 ...
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.
Read now
Unlock full access
More than 5,000 organizations count on O’Reilly
O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.Julian F.
I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.Addison B.
I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.Amir M.
I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.