Skip to Content
面向数据科学家的实用统计学
book

面向数据科学家的实用统计学

by Peter Bruce, Andrew Bruce
October 2018
Beginner to intermediate
238 pages
6h 32m
Chinese
Posts & Telecom Press
Content preview from 面向数据科学家的实用统计学
178
|
第
6
章
奖金。集成方法的基本实现如下。
(1)
给定一个数据集,采用一种预测模型,并记录该模型的预测情况。
(2)
在同一数据集上,依次使用多个模型重复步骤
1
。
(3)
对于每个要预测的记录,对预测值取均值(或加权均值,也可以使用多数票)。
集成方法在决策树中得到了最系统、最有效的应用。集成树模型是一种强大的建模方法,
易于构建出好的预测模型。
除了上面的简单集成算法,集成模型还有两种主要的变体:
Bagging
和
Boosting
。使用了
树模型的集成方法被称为
随机森林
模型,或者
提升决策树
(
boosted tree
)模型。本节内容
主要侧重于
Bagging
,而
Boosting
将在
6.4
节中介绍。
6.3.1
 
Bagging
方法
Bagging
方法最早是由利奥
•
布莱曼在
1994
年提出的,
Bagging
是
bootstrap aggregating
(自助法聚合)的缩写。
Bagging
方法和集成的基本算法类似,只是
Bagging
并不是要在同一数据上拟合所有的模
型,而是对使用每个自助法重抽样拟合一个新模型。给定响应变量
Y
和具有
P
个预测变量
X
=
X
1
,
X
2
,
…
,
X
p
的
n
条记录,下面给出形式化的算法描述。
(1)
初始化要拟合的模型数
M
和要选取的记录数
n
(
n
<
N
)。设置迭代计数
m
= 1
。
(2)
对训练数据做一次具有
n
条记录的自助重抽样(即有放回的抽样),得到子样本
Y
m
和
X
m
(即“
bag
”)。
(3)
使用
Y
m
和
X
m
训练模型,创建一组决策规则
ˆ
( )
m
f X
。
(4)
增加模型计数器,
m
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.

Read now

Unlock full access

More than 5,000 organizations count on O’Reilly

AirBnbBlueOriginElectronic ArtsHomeDepotNasdaqRakutenTata Consultancy Services

QuotationMarkO’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.
Julian F.
Head of Cybersecurity
QuotationMarkI wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.
Addison B.
Field Engineer
QuotationMarkI’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.
Amir M.
Data Platform Tech Lead
QuotationMarkI'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.
Mark W.
Embedded Software Engineer

You might also like

基于Python的智能文本分析

基于Python的智能文本分析

Benjamin Bengfort, Rebecca Bilbro, Tony Ojeda
Python数据处理

Python数据处理

Jacqueline Kazil, Katharine Jarmul
精通機器學習

精通機器學習

Aurélien Géron
C++语言导学(原书第2版)

C++语言导学(原书第2版)

本贾尼 斯特劳斯特鲁普

Publisher Resources

ISBN: 9787115493668