Skip to Content
面向数据科学家的实用统计学
book

面向数据科学家的实用统计学

by Peter Bruce, Andrew Bruce
October 2018
Beginner to intermediate
238 pages
6h 32m
Chinese
Posts & Telecom Press
Content preview from 面向数据科学家的实用统计学
回归与预测
|
123
图 4-6:确定有最大影响的观测点的绘图
表
4-2
比较了回归与整个数据集,其中移除了强影响数据点。从表中可以看到,Bathrooms
回归系数的变化很大
8
。
表4-2:使用全部数据以及移除强影响数据后,回归系数的对比情况
原始数据 移除强影响数据后
截距
-
772 550
-
647 137
SqFtTotLiving
210 230
SqFtLot
39 33
Bathrooms
2282
-
16 132
Bedrooms
-
26 320
-
22 888
BldgGrade
130 000 114 871
如果希望拟合的回归能可靠地预测未来的数据,那么识别强影响观测值只对小规模数据集
有用。对于涉及大量记录的回归,单个观测值并不足以对拟合函数产生极端的影响(尽管回
归可能依然有很大的离群值)。但是对于异常检测而言,识别强影响观测值是十分有用的。
4.6.3
 异方差性
、
非正态分布和相关误差
统计学家十分关注残差的分布情况。普通最小二乘法(参见
4.1.3
节)已被证实是无偏的,
并且在一些情况下,对于很多分布假设来说是一种最优的估计。这意味着,在多数问题
注
8
:
Bathrooms
的回归系数会变成负值,这是不直观的。这是因为回归中并未考虑地段的情况,并且在邮
政编码
98105
区域中,还包括了不同类型的房屋。对混淆变量的讨论,参见
4.5.3
节。
124
|
第
4
章
中,数据科学家无须过于关心残差的分布情况。
残差分布主要与形式统计推断的有效性(即假设验证和
p
值)相关,这对于数据科学家而
言是无关紧要的,因为数据科学家主要关心的是准确性。要使形式推断完全有效 ...
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.

Read now

Unlock full access

More than 5,000 organizations count on O’Reilly

AirBnbBlueOriginElectronic ArtsHomeDepotNasdaqRakutenTata Consultancy Services

QuotationMarkO’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.
Julian F.
Head of Cybersecurity
QuotationMarkI wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.
Addison B.
Field Engineer
QuotationMarkI’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.
Amir M.
Data Platform Tech Lead
QuotationMarkI'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.
Mark W.
Embedded Software Engineer

You might also like

精通機器學習

精通機器學習

Aurélien Géron
基于Python的智能文本分析

基于Python的智能文本分析

Benjamin Bengfort, Rebecca Bilbro, Tony Ojeda
Python数据处理

Python数据处理

Jacqueline Kazil, Katharine Jarmul

Publisher Resources

ISBN: 9787115493668