Skip to Content
面向数据科学家的实用统计学
book

面向数据科学家的实用统计学

by Peter Bruce, Andrew Bruce
October 2018
Beginner to intermediate
238 pages
6h 32m
Chinese
Posts & Telecom Press
Content preview from 面向数据科学家的实用统计学
184
|
第
6
章
6.4
 
Boosting
集成模型已经成为预测建模的一种标准工具。
Boosting
是创建集成模型的一种通用方法。
它与
Bagging
(参见
6.3
节)几乎同时被提出。和
Bagging
一样,
Boosting
也最常用于决策
树。尽管两者之间具有很多相似之处,但是
Boosting
采用了完全不同的方法,实现也更为
庞杂。因此,
Bagging
可以在略微调整的情况下使用,但在应用
Boosting
时则需要更为慎
重。如果我们用汽车来比喻这两种方法,那么
Bagging
可以看成本田雅阁,可靠并且稳定,
而
Boosting
可以看成保时捷,尽管强大,但需要谨慎驾驶。
在线性回归模型中,经常需要检查残差的情况,以查看是否可以改进拟合(参见
4.6.4
节 )。
Boosting
更进一步,它对一系列模型做拟合,并使用当前的拟合模型去最小化之前
模型的误差。
Boosting
算法有几种常见的变体,分别是
Adaboost
、
梯度提升
和
随机梯度
提升
。其中,随机梯度提升最通用也是使用最广泛的。实际上,如果选择了正确的参数,
Boosting
算法可以与随机森林相媲美。
主要术语
集成
使用一组模型做出预测。
同义词:模型平均
Boosting
在拟合一组模型时所使用的一种通用方法。
Boosting
在每轮连续的拟合中,会对
具有更大残差的记录赋予更大的权重。
Adaboost
Boosting
算法的一种早期实现,它根据残差的情况对数据重新加权。
梯度提升
一种更通用的
Boosting
算法。它将问题转化为代价函数最小化的问题。
随机梯度提升
(
SGD
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.

Read now

Unlock full access

More than 5,000 organizations count on O’Reilly

AirBnbBlueOriginElectronic ArtsHomeDepotNasdaqRakutenTata Consultancy Services

QuotationMarkO’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.
Julian F.
Head of Cybersecurity
QuotationMarkI wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.
Addison B.
Field Engineer
QuotationMarkI’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.
Amir M.
Data Platform Tech Lead
QuotationMarkI'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.
Mark W.
Embedded Software Engineer

You might also like

基于Python的智能文本分析

基于Python的智能文本分析

Benjamin Bengfort, Rebecca Bilbro, Tony Ojeda
Python数据处理

Python数据处理

Jacqueline Kazil, Katharine Jarmul
精通機器學習

精通機器學習

Aurélien Géron
C++语言导学(原书第2版)

C++语言导学(原书第2版)

本贾尼 斯特劳斯特鲁普

Publisher Resources

ISBN: 9787115493668