Skip to Content
面向数据科学家的实用统计学
book

面向数据科学家的实用统计学

by Peter Bruce, Andrew Bruce
October 2018
Beginner to intermediate
238 pages
6h 32m
Chinese
Posts & Telecom Press
Content preview from 面向数据科学家的实用统计学
106
|
第
4
章
ˆ
ˆ
( )
b
b
t
SE b
=
t
统计量及其镜像(即
p
值)测定了系数“统计显著”的程度,即超出预测变量和目标变
量的随机分配可能生成的范围。
t
统计量越大,即
p
值越低,那么预测变量的显著性越高。
鉴于“简约性”(
parsimony
)是建模中的一个基本理念,此类工具对于指导如何选择添加
到预测因子中的变量十分有用(参见
4.2.4
节 )。
除了
t
统计量之外,
R
和其他统计软件包通常还会给出
p
值和
F
统计量。例
如,
p
值在
R
语言输出中显示为
Pr(>|t|)
列。数据科学家一般并不关注这些
统计量的解释,也不关注统计显著性的问题。数据科学家主要关注的是
t
统
计量,并且使用它来指导是否需要将一个预测因子加入到模型中。如果
t
统
计量很大,即
p
值接近于
0
,就表示应该将预测因子保留在模型中。如果
t
统计量非常小,则表示该预测因子应该被丢弃。更多细节,参见
3.4.1
节。
4.2.3
 交叉验证
经典的统计回归度量(
R
2
、
F
统计量和
p
值)都是“样本内”(
in-sample
)度量,即应用于
拟合模型所使用的同一数据上。我们可以直观地感受到,从原始数据中取出一些数据,并
不在拟合模型时使用这些数据,这种做法是十分有意义的。随后,我们可以使用这些留出
的数据(即验证集)去验证模型的效果。通常,我们可以使用大部分数据去拟合模型,然
后使用余下的较小一部分数据去验证模型。
这种“样本外”(
out-of-sample
)验证的理念并不新颖,但是直到更大规模的数据集越来越
普遍时,该理念才真正地得以实施。在使用小数据集时,分析人员总希望使用所有的数据 ...
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.

Read now

Unlock full access

More than 5,000 organizations count on O’Reilly

AirBnbBlueOriginElectronic ArtsHomeDepotNasdaqRakutenTata Consultancy Services

QuotationMarkO’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.
Julian F.
Head of Cybersecurity
QuotationMarkI wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.
Addison B.
Field Engineer
QuotationMarkI’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.
Amir M.
Data Platform Tech Lead
QuotationMarkI'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.
Mark W.
Embedded Software Engineer

You might also like

基于Python的智能文本分析

基于Python的智能文本分析

Benjamin Bengfort, Rebecca Bilbro, Tony Ojeda
Python数据处理

Python数据处理

Jacqueline Kazil, Katharine Jarmul
精通機器學習

精通機器學習

Aurélien Géron
C++语言导学(原书第2版)

C++语言导学(原书第2版)

本贾尼 斯特劳斯特鲁普

Publisher Resources

ISBN: 9787115493668