October 2021
Beginner to intermediate
416 pages
9h 3m
Korean
Content preview from 살아 움직이는 머신러닝 파이프라인 설계: 텐서플로와 함께하는 머신러닝 프로젝트 자동화
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.
304
살아 움직이는 머신러닝 파이프라인 설계
다음을 실행해서 에어플로가 새 파이프라인을 인식하는지 테스트해보죠.
$
airflow list_dags
-------------------------------------------------------------------
DAGS
-------------------------------------------------------------------
basic_pipeline
파이프라인이 성공적으로 인식되었음을 보여줍니다.
에어플로 파이프라인에 숨겨진 원리를 이해했으니, 예제 프로젝트에 적용해 보겠습니다.
11.7
아파치 에어플로를 사용한
TFX
파이프라인 설정
이 절에서는 에어플로를 사용하여
TFX
파이프라인을 조정하는 방법을 설명합니다. 따라서 에
어플로의
UI
및 스케줄링 피처처럼 프로덕션 설정에서 매우 유용한 피처를 사용할 수 있습니다.
11.7.1
파이프라인 설정
에어플로를 사용하여
TFX
파이프라인을 설정하는 작업은
BeamDagRunner
설정과 매우 유사
합니다. 다만 에어플로 사용 사례에서는 더 많은 설정을 해야 합니다.
우리는
BeamDagRunner
대신
AirflowDAGRunner
를 사용합니다. 실행자는 아파치 에어
플로의 구성 (
11
.
6
.
1
‘설치 및 초기 설정’에서와 같은 구성 )인 추가 ...
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.
Read now
Unlock full access
More than 5,000 organizations count on O’Reilly
O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.Julian F.
I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.Addison B.
I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.Amir M.
I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.