March 2023
Beginner to intermediate
436 pages
9h 20m
Korean
Content preview from 머신러닝 시스템 설계
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.
265
7
장
모델 배포와 예측 서비스
ML
모델을 실행할 하드웨어는 종류가 매우 많습니다. 그렇다면 임의의 하드웨어에서 모델을
효율적으로 실행하려면 어떻게 해야 할까요? 이어지는 절에서 모델을 특정 하드웨어 백엔드에
서 실행하기 위해 컴파일하고 최적화하는 방법을 알아봅니다. 이 과정에서 중간 표현
Intermediate
Representation
(
IR
)과 컴파일러를 비롯해 에지에서 모델을 처리할 때 접하는 중요한 개념을 소개
합니다.
46
7.4.1 7.4.1
에지 디바이스용 모델 컴파일 및 최적화에지 디바이스용 모델 컴파일 및 최적화
특정 프레임워크, 예컨대 텐서플로나 파이토치로 빌드한 모델이 하드웨어 백엔드에서 실행되
려면 하드웨어 공급업체에서 해당 프레임워크를 지원해야 합니다. 한 가지 예로,
TPU
는
2018
년
2
월에 공개됐지만 파이토치는
2020
년
9
월에야
TPU
를 지원하기 시작했습니다. 그 전에는
TPU
를 사용하려면
TPU
가 지원하는 프레임워크를 사용해야 했죠.
하드웨어 백엔드에서 프레임워크에 대한 지원을 제공하는 것은 엔지어니어링 노력이 많이 들
기에 시간이 걸립니다.
ML
워크로드에서 하드웨어 백엔드로 매핑하려면 해당 하드웨어의 설
계를 이해하고 활용할 줄 알아야 하는데, 하드웨어 백엔드에 따라 메모리 레이아웃과 계산 기
본 단위가 다릅니다 (그림 ...
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.
Read now
Unlock full access
More than 5,000 organizations count on O’Reilly
O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.Julian F.
I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.Addison B.
I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.Amir M.
I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.