>>> ax2.set_title('After convolving with a Gaussian filter')
>>> ax2.set_adjustable('box-forced')
输入图像使用高斯滤波器求卷积后
图8-10:应用二维高斯滤波器前后的小猫图片
AlexNet
中的卷积层是三维的,也就是说它们处理的是来自于前一层的三维像素(表示三
维图像空间的数组值)。第一个卷积神经网络接受原始
RGB
图像并学习出卷积滤波器,可
用于在所有三个颜色通道上的局部图像邻域。随后的几层接受输入的三位像素,沿着空间
和核维度进行处理。参考图
8-14
获得更多详细信息。
8.3.3
ReLU
变换
神经网络的输出通常被传递到另一种非线性变换中,这种非线性变换又称为
激活函数
。常
用的激活函数包括
tanh
函数(一个位于
-
1
和
1
之间的平滑非线性函数)、
sigmoid
函数
(一个位于
0
和
1
之间的平滑非线性函数,在
4.3
节中介绍过),以及所谓的
线性整流函数
(
ReLU
)。
ReLU
是线性函数的一个简单变种,它的负数部分都被归零。也就是说,它裁剪
掉了负数部分,保留了无界的正数部分。
ReLU
的取值范围是
0
到
∞
。
常用激活函数
ReLU
是一个负数部分归零的线性函数:
ReLU(
x
) = max(0,
x
)
tanh
函数是一个平滑地从
-
1
增长到
1
的三角函数:
sinh()
tanh( ...
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month, and much more.
O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.
Julian F.
Head of Cybersecurity
I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.
Addison B.
Field Engineer
I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.
Amir M.
Data Platform Tech Lead
I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.