October 2021
Beginner to intermediate
416 pages
9h 3m
Korean
Content preview from 살아 움직이는 머신러닝 파이프라인 설계: 텐서플로와 함께하는 머신러닝 프로젝트 자동화
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.
96
살아 움직이는 머신러닝 파이프라인 설계
미국 주
州
목록을 업데이트하여 알래스카(
AK
)를 제거할 수도 있습니다.
state_domain = tfdv.get_domain(schema, ‘state’)
state_domain.value.remove(‘AK’)
스키마가 검증되면 다음과 같이 스키마 파일을 직렬화하여 다음 위치에 생성합니다.
tfdv.write_schema_text(schema, schema_location)
그리고 통계를 다시 확인하여 업데이트된 이상치를 확인해야 합니다.
updated_anomalies = tfdv.validate_statistics(eval_stats, schema)
tfdv.display_anomalies(updated_anomalies)
이런 방식으로 이상치를 데이터셋에 적합하도록 조정할 수 있습니다.
8
4.3.3
데이터 스큐 및 드리프트
TFDV
는 두 데이터셋의 통계 간의 큰 차이를 감지하는 내장 ‘스큐
skew
비교기’를 제공합니다.
이는 스큐 (평균 주위에 비대칭적으로 분포된 데이터셋 )의 통계적 정의가 아닙니다.
TFDV
에
서는 두 데이터셋의
service
_
statistics
간의 차이에 대한
L
-
infinity
Norm
으로 정의됩
니다. 두 데이터셋 간의 차이가 특정 피처에 대한
L
-
infinity
Norm
의 임곗값을
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.
Read now
Unlock full access
More than 5,000 organizations count on O’Reilly
O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.Julian F.
I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.Addison B.
I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.Amir M.
I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.