October 2021
Beginner to intermediate
416 pages
9h 3m
Korean
Content preview from 살아 움직이는 머신러닝 파이프라인 설계: 텐서플로와 함께하는 머신러닝 프로젝트 자동화
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.
246
살아 움직이는 머신러닝 파이프라인 설계
9.2.1
양자화
신경망의 가중치는
32
비트 부동소수점 데이터 형식 (또는
IEEE
754
표준에 따라 단일 정밀 이
진 부동소수점 형식 )으로 저장할 때가 많습니다. 부동소수점 수는 부호를 저장하는
1
비트, 지
수
8
비트, 부동소수점 정밀도
23
비트로 저장됩니다.
그러나 네트워크 가중치는
bfloat16
부동소수점 형식이나
8
비트 정수로 표시할 수 있습니다.
[그림
9
-
2
]와 같이, 숫자 부호를 저장하는 데는 여전히
1
비트가 필요합니다. 지수 또한 텐서플
로에서 사용하므로 가중치를
bfloat16
부동소수점으로 저장할 때도
8
비트로 표현합니다. 그
러나 분수 표현은
23
비트에서
7
비트로 감소합니다. 때로는
8
비트만 사용하여 가중치를 정수로
나타내기도 합니다.
1 1 0 ... ...1 0 0 1 0 0 01 1 1 0 0 01 110
1 1 0 1 0 1 0 1 1 00 0 11 10
부호 지수 부분 (8비트)
부호 지수 부분 (8비트) 가수 부분 (7비트)
가수 부분 (23비트) IEEE 754
싱글 정밀도
32비트 실수형
bfloat16
실수형 포맷
그림
9-2
부동 정밀도 감소
네트워크의 가중치 표현을
16
비트 부동소수점이나 정수로 변경하면 다음과 같은 이점을 얻을
수 있습니다.
●
가중치는 더 적은 바이트로 나타낼 ...
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.
Read now
Unlock full access
More than 5,000 organizations count on O’Reilly
O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.Julian F.
I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.Addison B.
I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.Amir M.
I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.