August 2021
Beginner to intermediate
720 pages
15h 32m
Korean
Content preview from fastai와 파이토치가 만나 꽃피운 딥러닝
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.
603
16
학습 과정
여전히 결과가 매우 좋지는 않습니다. 모멘텀 외에 또 무엇을 시도할 수 있는지 살펴보죠.
16.4
RMSProp
RMSProp
은
SGD
의 변종입니다. 코세라
Coursera
의 ‘
Neural
Networks
for
Machine
Learning
’ 수업의 ‘
Lecture
6e
(
https
://
oreil
.
ly
/
FVcIE
)’에서 제프리 힌튼이 소개했습니
다. 적응형 학습률을 사용한다는 점이
SGD
와 가장 다릅니다. 즉 모든 파라미터에 같은 학습률
을 사용하지 않고, 파라미터마다 자체 학습률을 사용하죠. 단, 이런 학습률은 전역 학습률이 제
어합니다. 이 방식은 변화가 많이 필요한 가중치에는 높은 학습률을, 이미 충분히 좋은 값에 안
착한 가중치에는 낮은 학습률을 적용하여 학습 시간을 단축합니다.
그렇다면 파라미터의 학습률을 어떻게 결정할까요? 그레이디언트를 관찰해서 판단을 내릴 수
있습니다. 특정 파라미터의 그레이디언트가 한동안
0
에 가까웠다면, 손실이 평평하므로 높은
학습률이 필요합니다. 반면 그레이디언트의 값이 들쭉날쭉하다면 낮은 학습률을 세심히 선정
하여 그레이디언트가 발산하지 않도록 막아야 합니다. 단순히 그레이디언트의 평균으로는 큰
변화를 알아채기 어렵습니다. 큰 양수와 큰 음수는 평균을
0
에 가깝게 만들기 때문입니다. 대
신 일상적으로 사용하는 ...
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.
Read now
Unlock full access
More than 5,000 organizations count on O’Reilly
O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.Julian F.
I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.Addison B.
I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.Amir M.
I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.