August 2021
Beginner to intermediate
720 pages
15h 32m
Korean
Content preview from fastai와 파이토치가 만나 꽃피운 딥러닝
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.
497
12
밑바닥부터 구현하는 언어 모델
그림
12-8
부동소수의 정밀도
이 부정확성은 심층 네트워크에서 가중치 갱신을 위해 계산된 그레이디언트가 종종
0
또는 무
한대가 됨을 의미합니다. 그리고 이 문제를 보통
vanishing
gradient
또는
exploding
gradient
문제라고 합니다.
SGD
의 입장에서 설명하면, 이는 가중치가 전혀 갱
신되지 않거나 무한대로 점프함을 의미하죠. 어느 쪽이든 학습을 해도 결과가 전혀 개선되지
않습니다.
연구자들은 이 문제를 해결하는 다양한 방법을 개발했습니다 (이 내용은 나중에 다루겠습니
다). 한 가지 방법은 활성이 폭발적으로 커질 가능성을 줄이는 방식으로 계층의 정의를 바꾸는
것입니다. 배치 정규화를 다루는
13
장과
ResNets
를 다루는
14
장에서 이 방법을 자세히 다룹
니다. 그러나 사실 이런 세부 사항은 크게 중요하지 않습니다. 이 문제를 해결하는 새로운 접근
방식을 고안하는 연구자가 아니라면 말이죠. 이를 처리하는 또 다른 전략은 초기화에 주의하는
것입니다.
17
장에서 이를 자세히 다룹니다.
RNN
에서는 폭발적으로 커지는 활성을 방지하는 데 게이트 순환 유닛
gated
recurrent
unit
(
GRU
)과
장단기 메모리
long
short
term
memory
(
LSTM ...
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.
Read now
Unlock full access
More than 5,000 organizations count on O’Reilly
O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.Julian F.
I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.Addison B.
I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.Amir M.
I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.