October 2021
Beginner to intermediate
416 pages
9h 3m
Korean
Content preview from 살아 움직이는 머신러닝 파이프라인 설계: 텐서플로와 함께하는 머신러닝 프로젝트 자동화
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.
85
4
장
데이터 검증
3
장에서는 다양한 소스에서 파이프라인으로 데이터를 수집하는 방법을 살펴봤습니다. 이 장에
서는 [그림
4
-
1
]과 같이 데이터를 검증하여 사용하려고 합니다.
데이터
수집
파이프라인
오케스트레이션
메타데이터스토어 데이터베이스
데이터
검증
데이터
전처리
모델 피드백 루프
모델
학습
모델 분석 및
검증
모델
배포
그림
4-1
머신러닝 파이프라인의 일부인 데이터 검증
데이터는 모든 머신러닝 모델의 기본입니다. 또한 모델의 유용성과 성능은 모델을 학습, 검증,
분석하는 데 사용하는 데이터에 따라 달라집니다. 강력한 데이터가 없으면 강력한 모델을 구축
할 수 없습니다. “쓰레기를 넣으면, 쓰레기가 나온다
Garbage
in
,
Garbage
out
(
GIGO
)”라는 말을 들
어본 적이 있으신지요? 기본 데이터를 선별하고 검증하지 않으면 모델이 제대로 학습하지 못
합니다. 따라서 머신러닝 파이프라인의 첫 번째 워크플로 단계인 데이터 검증을 거쳐야 합니다.
이 장에서는 먼저 데이터 검증이라는 아이디어의 필요성을 언급합니다. 그리고 텐서플로 익스
텐디드 생태계에서 제공하는 파이썬 패키지인
TFDV
TensorFlow
Data
Validation
를 소개합니다. 데이
터 과학 프로젝트에서 패키지를 설정하고, 일반적인 사용 사례를 안내하며, 매우 유용한 워크
데이터 검증
CHAPTER
4
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.
Read now
Unlock full access
More than 5,000 organizations count on O’Reilly
O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.Julian F.
I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.Addison B.
I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.Amir M.
I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.