October 2021
Beginner to intermediate
416 pages
9h 3m
Korean
Content preview from 살아 움직이는 머신러닝 파이프라인 설계: 텐서플로와 함께하는 머신러닝 프로젝트 자동화
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.
65
3
장
데이터 수집
2
TFRecord
는 대량의 데이터를 빠르게 다운로드하거나 쓰도록 최적화되었습니다.
3
tf
.
Example
(
TFRecord
내의 모든 데이터 행을 나타내는 데이터 구조 )은 텐서플로 생태계의 기본
데이터 구조이므로 모든
TFX
컴포넌트에서 사용합니다.
데이터셋을 수집, 분할, 변환하는 프로세스는
ExampleGen
컴포넌트가 수행합니다. 다음 예에
서 볼 수 있듯이 데이터셋은 로컬 및 원격 폴더에서 읽을 수 있을 뿐만 아니라 구글 클라우드
빅쿼리와 같은 데이터 서비스에서 요청할 수도 있습니다.
3.1.1
로컬 데이터 파일 수집
ExampleGen
컴포넌트는
CSV
(쉼표로 구분된 값 파일 ), 사전 계산된
TFRecord
파일, 아파치
아브로
Apache
Avro
, 아파치 파케이
Apache
Parquet
의 직렬화 출력 등 몇 가지 데이터 구조를 수집할
수 있습니다.
쉼표로 구분된 데이터를
tf
.
Example
로 변환하기
정형 데이터나 텍스트 데이터가 있는 데이터셋은
CSV
파일에 저장된 경우가 많습니다.
TFX
는 이런 파일을 읽고
tf
.
Example
로 변환하는 피처를 제공합니다. 다음 코드는 예제 프로젝트
의
CSV
데이터를 포함하는 폴더의 수집을 보여줍니다.
import os
from pathlib import Path
from tfx.components ...
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.
Read now
Unlock full access
More than 5,000 organizations count on O’Reilly
O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.Julian F.
I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.Addison B.
I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.Amir M.
I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.