October 2021
Beginner to intermediate
416 pages
9h 3m
Korean
Content preview from 살아 움직이는 머신러닝 파이프라인 설계: 텐서플로와 함께하는 머신러닝 프로젝트 자동화
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.
57
2
장
TFX - 텐서플로 익스텐디드
니다.
4
장에서 텐서플로 데이터 검증,
5
장에서 텐서플로 변환을 다룰 때
TFX
생태계에서 아파
치 빔의 구체적인 사용에 대해 논의하겠습니다.
아파치 빔은 지원하는 런타임 도구에서 데이터 처리 과정을 추상화하며 여러 분산 처리 런타임
환경에서 실행될 수 있습니다. 즉, 파이프라인을 변경하지 않고 아파치 스파크
Apache
Spark
나 구
글 클라우드 데이터플로
Google
Cloud
Dataflow
에서 동일한 데이터 파이프라인을 실행할 수 있습니
다. 또한 아파치 빔은 배치 프로세스 설명과 더불어 스트리밍 작업을 원활하게 지원하기 위해
개발되었습니다.
2.7.1
설치
아파치 빔 설치는 간단합니다. 다음 명령을 사용하여 최신 버전을 설치할 수 있습니다.
$ pip install apache-beam
아파치 빔을 구글 클라우드 플랫폼
Google
Cloud
Platform
상에서 설치하려면 다음과 같이 설치해야
합니다. 예를 들어 구글 빅쿼리
Google
BigQuery
의 데이터를 처리하거나 구글 클라우드 데이터플로
에서 데이터 파이프라인을 실행할 때죠 (
4
.
4
절 ‘
GCP
를 사용한 대용량 데이터셋 처리’ 참고 ).
$ pip install ‘apache-beam[gcp]’
AWS
Amazon
Web
Services
상에서 아파치 빔을 ...
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.
Read now
Unlock full access
More than 5,000 organizations count on O’Reilly
O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.Julian F.
I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.Addison B.
I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.Amir M.
I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.