May 2020
Beginner to intermediate
952 pages
24h 11m
Korean
Content preview from 핸즈온 머신러닝(2판): 사이킷런, 케라스, 텐서플로 2를 활용한 머신러닝, 딥러닝 완벽 실무
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.
439
11
장
심층 신경망 훈련하기
(가파른 차원)
AdaGrad
경사 하강법
(완만한 차원)
비용
그림
11-7
AdaGrad
와 경사 하강법:
AdaGrad
는 최적점을 향하여 일찍 방향을 바꿀 수 있습니다.
AdaGrad
는 간단한
2
차방정식 문제에 대해서는 잘 작동하지만 신경망을 훈련할 때 너무 일찍
멈추는 경우가 종종 있습니다. 학습률이 너무 감소되어 전역 최적점에 도착하기 전에 알고리
즘이 완전히 멈춥니다. 그래서 케라스에
Adagrad
옵티마이저가 있지만 심층 신경망에는 사용
하지 말아야 합니다(하지만 선형 회귀 같은 간단한 작업에는 효과적일 수 있습니다). 하지만
AdaGrad
를 알면 다른 적응적 학습률 옵티마이저를 이해하는 데 도움이 됩니다.
33
11.3.4
RMSProp
AdaGrad
는 너무 빨리 느려져서 전역 최적점에 수렴하지 못하는 위험이 있습니다.
RMSProp
알고리즘
34
은 (훈련 시작부터의 모든 그레이디언트가 아닌) 가장 최근 반복에서 비롯된 그레
이디언트만 누적함으로써 이 문제를 해결했습니다. 이렇게 하기 위해 알고리즘의 첫 번째 단계
에서 지수 감소를 사용합니다 (식
11
-
7
).
33
옮긴이_ 케라스에서는
optimizer
=
keras
.
optimizers
.
Adagrad
(
learning
_
rate
=
0
.
001
)
와 같이 사용합니다.
learning ...
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.
Read now
Unlock full access
More than 5,000 organizations count on O’Reilly
O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.Julian F.
I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.Addison B.
I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.Amir M.
I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.