January 2017
Beginner to intermediate
312 pages
7h 3m
Korean
Content preview from 밑바닥부터 시작하는 딥러닝
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.
192
밑바닥부터 시작하는 딥러닝
을 합니다. 매개변수 갱신은
optimizer
가 책임지고 수행하니 우리는
optimizer
에 매개변수와
기울기 정보만 넘겨주면 되는 것이죠.
이처럼 최적화를 담당하는 클래스를 분리해 구현하면 기능을 모듈화하기 좋습니다. 예를 들어
곧이어 소개할 모멘텀이라는 최적화 기법 역시
update
(
params
,
grads
)라는 공통의 메서드
를 갖도록 구현합니다. 그때
optimizer
=
SGD
( ) 문장을
optimizer
=
Momentum
( )으로
만 변경하면
SGD
를 모멘텀으로 바꿀 수 있는 것이죠.
대부분의 딥러닝 프레임워크는 다양한 최적화 기법을 구현해 제공하며, 원하는 기법으로 쉽게 바꿀
수 있는 구조로 되어 있습니다. 예를 들어
Lasagne
이라는 딥러닝 프레임워크는 다양한 최적화 기법 구현해
updates
.
py
*
파일에 함수로 정리해두었습니다. 사용자는 그중 쓰고 싶은 기법을 선택할 수 있습니다.
6.1.3
SGD
의 단점
SGD
는 단순하고 구현도 쉽지만, 문제에 따라서는 비효율적일 때가 있습니다. 이번 절에서는
SGD
의 단점을 알아보고자 다음 함수의 최솟값을 구하는 문제를 생각해보겠습니다.
fx
yx
y(,)
20
1
22
=+
[식 6.2 ]
이 함수는 [그림
6
-
1
]의 왼쪽과 같이 ‘밥그릇’을
x
축 방향으로 늘인 듯한 ...
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.
Read now
Unlock full access
More than 5,000 organizations count on O’Reilly
O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.Julian F.
I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.Addison B.
I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.Amir M.
I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.