August 2021
Beginner to intermediate
720 pages
15h 32m
Korean
Content preview from fastai와 파이토치가 만나 꽃피운 딥러닝
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.
595
16
학습 과정
지금까지 영상 처리, 자연어 처리, 테이블 데이터 분석, 협업 필터링의 최신 구조를 생성하고
빠르게 학습시키는 방법을 배웠습니다. 그러면 모든 내용을 다 배웠다고 볼 수 있을까요? 아직
은 아닙니다. 학습 과정을 조금 더 살펴봐야 하죠.
4
장에서는 기본적인 확률적 경사 하강법을 다뤘습니다. 모델에 미니배치를 넣고, 손실 함수로
타깃과 비교하고, 가중치 갱신 전에 각 가중치에 대한 손실 함수의 그레이디언트를 계산하는
내용이었죠.
new_weight = weight - lr * weight.grad
이를 학습 루프 내에서 밑바닥부터 구현했고, 각 파라미터 계산을 수행하는 간단한
nn
.
SGD
클
래스를 파이토치가 제공함을 확인했습니다. 이 장에서는 유연한 기반 프레임워크로 더 빠른 옵
티마이저를 만들어 봅니다. 그러려면 학습 과정의 일부분을 수정해야 합니다. 예를 들어 학습
루프를 변경하려면 순수
SGD
에 코드를 추가하는 방법을 알아야 하죠.
fastai
라이브러리는 이
런 변경을 쉽게 해주는 콜백 시스템을 제공합니다. 지금부터 함께 살펴보죠.
표준
SGD
로 시작해서 기준선을 정합니다. 그리고 일반적으로 사용하는 옵티마이저들을 하나
씩 살펴보겠습니다.
CHAPTER
16
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.
Read now
Unlock full access
More than 5,000 organizations count on O’Reilly
O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.Julian F.
I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.Addison B.
I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.Amir M.
I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.