October 2021
Beginner to intermediate
416 pages
9h 3m
Korean
Content preview from 살아 움직이는 머신러닝 파이프라인 설계: 텐서플로와 함께하는 머신러닝 프로젝트 자동화
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.
342
살아 움직이는 머신러닝 파이프라인 설계
빔 구성은 파이프라인 인스턴스화로 전달됩니다.
tmp_file_location = os.path.join(output_bucket, “tmp”)
beam_pipeline_args = [
“--runner=DataflowRunner”,
“--experiments=shuffle_mode=auto”,
“--project={}”.format(project_id),
“--temp_location={}”.format(tmp_file_location),
“--region={}”.format(gcp_region),
“--disk_size_gb=50”,
]
DataflowRunner
를
runner
유형으로 구성하고
shuffle
_
mode
를
auto
로 설정합니다. 이는
데이터플로의 흥미로운 기능입니다. 구글 컴퓨팅 엔진의
VM
에서
GroupByKey
와 같은 변환을
실행하는 대신 데이터플로의 서비스 백엔드에서 작업을 처리합니다. 따라서 컴퓨팅 인스턴스
의 실행 시간과
CPU
/메모리 비용이 줄어듭니다.
12.3.3
파이프라인 실행
구글 클라우드
AI
플랫폼으로 파이프라인을 실행하는 것은
12
.
2
절 ‘쿠브플로 파이프라인을 사
용한
TFX
파이프라인 조정’에서 살펴본 내용과 다르지 않습니다.
TFX
스크립트는
Argo
구성
을 생성합니다. ...
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.
Read now
Unlock full access
More than 5,000 organizations count on O’Reilly
O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.Julian F.
I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.Addison B.
I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.Amir M.
I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.