January 2017
Beginner to intermediate
312 pages
7h 3m
Korean
Content preview from 밑바닥부터 시작하는 딥러닝
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.
199
6
장
-
학습 관련 기술들
6.1.6
Adam
모멘텀은 공이 그릇을 구르는 듯한 물리 법칙에 따르는 움직임을 보였습니다.
AdaGrad
는 매
개변수의 원소마다 적응적으로 갱신 정도를 조정했습니다. 그럼 혹시 이 두 기법을 융합하면
어떻게 될까요? 이런 생각을 기초로 만든 기법이 바로
Adam
[
8
]
입니다.
*
Adam
은
2015
년에 제안된 새로운 방법입니다. 그 이론은 다소 복잡하지만 직관적으로는 모멘
텀과
AdaGrad
를 융합한 듯한 방법입니다. 이 두 방법의 이점을 조합했다면 매개변수 공간을
효율적으로 탐색해줄 것으로 기대해도 좋겠죠? 또, 하이퍼파라미터의 ‘편향 보정’이 진행된다
는 점도
Adam
의 특징입니다. 여기에서는 더 깊게 파고들진 않겠습니다. 궁금하신 분은 원논
문
[
8
]
을 참고하시고, 또
common
/
optimizer
.
py
에
Adam
클래스를 구현해두었으니 함께 보
시면 도움이 될 겁니다.
그럼
Adam
을 사용하여 [식
6
.
2
]의 최적화 문제를 풀어보겠습니다. 결과는 [그림
6
-
7
]과 같
습니다.
그림
6-7
Adam
에 의한 최적화 갱신 경로
*
이 책은
Adam
을 이해하기 쉽도록 직관적으로 설명하여, 완전히 정확하지는 않습니다. 자세한 내용은 원논문을 참고하세요.
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.
Read now
Unlock full access
More than 5,000 organizations count on O’Reilly
O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.Julian F.
I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.Addison B.
I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.Amir M.
I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.