October 2021
Beginner to intermediate
416 pages
9h 3m
Korean
Content preview from 살아 움직이는 머신러닝 파이프라인 설계: 텐서플로와 함께하는 머신러닝 프로젝트 자동화
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.
296
살아 움직이는 머신러닝 파이프라인 설계
11.5
아파치 빔으로
TFX
파이프라인 조정
아파치 빔은
TFX
의 종속성으로 이미 설치되었으므로 파이프라인 조정 도구로 사용하기 매우
쉽습니다. 빔에는 매우 단순한 기능만 있으며, 에어플로나 쿠브플로 파이프라인 같은 다양한
기능 (예: 그래프 시각화, 예약 실행 )이 없습니다.
그러나 빔은 에어플로 머신러닝 파이프라인을 디버깅하는 유용한 방법입니다. 파이프라인 디
버깅 중에 빔을 사용한 다음 에어플로나 쿠브플로 파이프라인으로 이동하면 더 복잡한 에어플
로와 쿠브플로 파이프라인 설정에서 발생하는 파이프라인 오류의 근본 원인을 배제할 수 있습
니다.
이 절에서는 예제
TFX
파이프라인을 빔으로 설정하고 실행하는 방법을 설명합니다.
2
장에서
소개한 빔
Pipeline
함수를 [예제
11
-
1
] 스크립트와 함께 파이프라인을 실행하는 데 사용하
겠습니다.
TFX
파이프라인 컴포넌트를 인수로 받아들이고
ML
메타데이터스토어를 보유한
SQLite
데이터베이스에도 연결하는 빔
Pipeline
을 정의합니다.
import absl
from tfx.orchestration import metadata, pipeline
def init_beam_pipeline(components, pipeline_root, direct_num_workers): ...
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.
Read now
Unlock full access
More than 5,000 organizations count on O’Reilly
O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.Julian F.
I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.Addison B.
I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.Amir M.
I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.