August 2021
Beginner to intermediate
720 pages
15h 32m
Korean
Content preview from fastai와 파이토치가 만나 꽃피운 딥러닝
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.
645
17
기초부터 만드는 신경망
서의 속성에 자동으로 채워지기 때문에
_
grad
함수들의 결과를 별도로 저장하지 않아도 됩니다.
단지 순전파의 반대 순서로 각
_
grad
함수를 호출하여 각 함수가
out
.
g
에 접근하도록 하면 되죠.
def forward_and_backward(inp, targ):
# 순전파
l1 = inp @ w1 + b1
l2 = relu(l1)
out = l2 @ w2 + b2
# 사실 역전파에는 loss가 필요 없습니다!
loss = mse(out, targ)
# 역전파
mse_grad(out, targ)
lin_grad(l2, out, w2, b2)
relu_grad(l1, l2)
lin_grad(inp, l1, w1, b1)
이제
w1
.
g
,
b1
.
g
,
w2
.
g
,
b2
.
g
로 모델 파라미터의 그레이디언트에 접근할 수 있습니다. 모델을
성공적으로 정의했으니, 이번에는 정의한 모델을 파이토치의 모듈과 닮은 형태로 만들어보죠.
17.2.3
앞서 작성한 모든 함수는 순전파와 역전파를 계산하려고 정의했으며, 때에 따라 적절히 조합하
여 사용했죠. 하지만 이런 함수를 순전파와 역전파라는 관점에서 클래스 단위로 만들 수도 있
습니다. 즉
relu
와
relu
_
grad
함수의 역할을 한 클래스로 묶을 수 있습니다. 그리고
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.
Read now
Unlock full access
More than 5,000 organizations count on O’Reilly
O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.Julian F.
I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.Addison B.
I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.Amir M.
I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.