August 2021
Beginner to intermediate
720 pages
15h 32m
Korean
Content preview from fastai와 파이토치가 만나 꽃피운 딥러닝
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.
486
3
딥러닝의 기반 지식
보다시피 반복하면서 활성이 매번 갱신됨을 알 수 있습니다. 그리고 활성은
hidden
state
를 표현하는
h
에 담기죠.
NOTE
_
RNN
의 각 단계에서 갱신되는 활성을 말합니다.
이처럼 반복문을 사용해 정의한 신경망을
(
RNN
)이라고 합니다.
RNN
은 복잡하고
새로운 구조가 아니라, 단순히
for
반복문으로 다층 신경망을 리팩터링한 것에 불과함을 인지
해야 합니다.
TIP
‘반복 신경망
looping
neural
networks
(
LNN
)’이라고 부른다면
50
% 정도 덜 부담스러워 보이리라 생각합니다!
RNN
이 무엇인지 알았으니 이제 약간 더 개선해보죠.
12.3
RNN
RNN
코드에는 모든 새 입력 시퀀스에 대한 은닉 상태를
0
으로 초기화한다는 문제가 있습니
다. 왜 문제가 될까요? 앞서 배치에 쉽게 맞출 수 있도록 데이터 시퀀스를 짧게 만들었습니다.
그런데 만약 올바르게 정렬된 시퀀스를 모델이 읽는다면, 긴 시퀀스가 모델에 노출될 것입니
다. 즉 실제로는 이어진 시퀀스지만, 짧게 만들어진 시퀀스로 쪼개고 학습하는 과정에서 중간
마다 은닉 상태가
0
으로 초기화되어 중간의 정보를 잃어버립니다.
또 다른 문제는 더 많은 신호가 있을 수 있다는 점입니다. 중간 단계의 예측을
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.
Read now
Unlock full access
More than 5,000 organizations count on O’Reilly
O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.Julian F.
I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.Addison B.
I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.Amir M.
I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.