Skip to Content
面向数据科学家的实用统计学
book

面向数据科学家的实用统计学

by Peter Bruce, Andrew Bruce
October 2018
Beginner to intermediate
238 pages
6h 32m
Chinese
Posts & Telecom Press
Content preview from 面向数据科学家的实用统计学
统计机器学习
|
185
(1)
初始化要拟合模型的最大数量
M
,并设置迭代计数器
m
= 1
。初始化观测值权重
1
i
w
N
=
,
其中
i
= 1, 2,
…
,
N
。初始化集成模型
0
ˆ
0F
=
。
(2)
使用
ˆ
m
f
训练模型。其中,
ˆ
m
f
使用使加权误差
e
m
最小化的观测权重
w
1
,
w
2
,
…
,
w
N
。加权
误差
e
m
定义为误分类观测的权重总和。
(3)
将模型添加到集成中:
1
ˆ
ˆ ˆ
m m m m
F F f
α
−
= +
,其中
1
log( )
m
m
m
e
e
α
−
=
。
(4)
更新权重
w
1
,
w
2
,
…
,
w
N
,使误分类观测值的权重增加。权重增加的规模取决于
α
m
。
α
m
值
越大,权重增加得越大。
(5)
增加模型计数器,
m
=
m
+ 1
。如果
m
≤
M
,返回步骤
1
。
Boosting
算法的估计值由下式给出:
Boosting
算法通过增加误分类观测值的权重,强制模型在训练中偏重于表现不佳的数据。
因子
α
m
确保了误差较低的模型具有更大的权重。
梯度提升算法与
Adaboost
类似,只是它将问题转化为代价函数的优化问题。梯度提升并不
是调整权重,而是根据
伪残差
去拟合模型,这使得在训练中偏重于较大的残差。梯度随机
提升遵循随机森林的理念,即在每一个阶段对观测值和预测变量抽样,由此在算法中加入
了随机性。
6.4.2
 
XGBoost
软件
XGBoost
是最广为使用的
Boosting
公共域软件,它是随机梯度提升算法的一种实现,最初
是由华盛顿大学的陈天奇和
Carlos Guestrin
开发的。
XGBoost
是一种具有多种选项的计算
很高效的实现,并在大多数主流数据科学语言中以软件包形式提供 ...
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.

Read now

Unlock full access

More than 5,000 organizations count on O’Reilly

AirBnbBlueOriginElectronic ArtsHomeDepotNasdaqRakutenTata Consultancy Services

QuotationMarkO’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.
Julian F.
Head of Cybersecurity
QuotationMarkI wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.
Addison B.
Field Engineer
QuotationMarkI’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.
Amir M.
Data Platform Tech Lead
QuotationMarkI'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.
Mark W.
Embedded Software Engineer

You might also like

基于Python的智能文本分析

基于Python的智能文本分析

Benjamin Bengfort, Rebecca Bilbro, Tony Ojeda
Python数据处理

Python数据处理

Jacqueline Kazil, Katharine Jarmul
精通機器學習

精通機器學習

Aurélien Géron
C++语言导学(原书第2版)

C++语言导学(原书第2版)

本贾尼 斯特劳斯特鲁普

Publisher Resources

ISBN: 9787115493668