October 2021
Beginner to intermediate
416 pages
9h 3m
Korean
Content preview from 살아 움직이는 머신러닝 파이프라인 설계: 텐서플로와 함께하는 머신러닝 프로젝트 자동화
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.
248
살아 움직이는 머신러닝 파이프라인 설계
학습
레코드
교사 신경망 예측된 레이블
예측된 레이블
손실 함수
가중치 업데이트
정답 레이블
학생 신경망
그림
9-3
교사 네트워크에서 학습하는 학생 네트워크
9.3
텐서플로 서빙에서
TensorRT
사용하기
학습된 텐서플로 모델을 프로덕션에 배포하기 전에 양자화하는 한 가지 방법은 엔비디아의
TensorRT
로 모델을 변환하는 것입니다.
엔비디아
GPU
에서 계산 집약적인 심층 학습 모델을 실행할 때 이를 사용하여 모델 서버를 최
적화할 수 있습니다. 엔비디아는
TensorRT
라는 라이브러리를 제공합니다. 네트워크 가중치
와 편향의 수치 표현 정밀도를 줄임으로써 딥러닝 모델의 추론을 최적화하는 라이브러리입니
다.
TensorRT
는
int8
과
float16
표현을 지원합니다. 정밀도가 감소하면 모델의 추론 지연 시
간이 줄어듭니다.
모델 학습 후에는
TensorRT
를 사용하여 모델을 최적화해야 합니다.
TensorRT
는 자체 옵티
마이저나
saved
_
model
_
cli
와 함께 사용할 수 있습니다.
29
그런 다음 최적화된 모델을 텐서플
로 서빙에 로드할 수 있습니다. 이 절을 작성할 당시
TensorRT
는
Tesla
V100
과
P4
를 포함한
특정 엔비디아 제품만 지원했습니다.
먼저 딥러닝 모델을
saved
_
model
_
cli
로 변환하겠습니다. ...
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.
Read now
Unlock full access
More than 5,000 organizations count on O’Reilly
O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.Julian F.
I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.Addison B.
I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.Amir M.
I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.