Skip to Content
面向数据科学家的实用统计学
book

面向数据科学家的实用统计学

by Peter Bruce, Andrew Bruce
October 2018
Beginner to intermediate
238 pages
6h 32m
Chinese
Posts & Telecom Press
Content preview from 面向数据科学家的实用统计学
探索性数据分析
|
9
据汇总和绘图中对离群值给出了一些惯例表示(参见
1.5.1
节),但是对离群值的准确定义
还是摆脱不了主观性。离群值本身并不一定是无效的或错误的数据(如上例中比尔
•
盖茨
的收入),但往往是由数据的错误所导致的,例如,混淆了数据的计量单位(混用了千米
与米),或是传感器的读数不准确。如果离群值是由不准确的数据导致的,这时使用均值
就会给出糟糕的位置估计,而使用中位数的估计则依然有效。无论是哪种情况,我们都应
找出离群值,而且它们通常也值得进一步研究。
异常检测
在普通的数据分析中,离群值有时富含信息,有时则令人头疼。而
异常检测
则不同,它所关注的就是离群值,而其余大部分数据则用于定义“正常”的
情况,即如何测定异常。
中位数并非唯一的稳健位置估计量。事实上,为了消除离群值的影响,也广泛地使用了切
尾均值。例如,除非数据集的规模很小,否则通常我们会将数据集的开头和结尾各舍弃
10%
,以使数据集免受离群值的影响。切尾均值可以看作一种在中位数和均值之间的折中
方案。它对数据集中的极值非常稳健,同时在计算位置估计量时使用了更多的数据。
其他稳健的位置估计量
统计学家还提出了很多其他的位置估计量,主要目的在于提供比均值更稳
健、更高效的估计量。其中更高效是指,能够更好地分辨数据集中的微小位
置差异。这些估计量通常适用于小规模的数据集,而对于大规模乃至中等规
模的数据集,它们并不能提供更多的帮助。
1.3.3
 位置估计的例子
:
人口和谋杀率
表
1-2
显示了一个数据集的前几行数据,其中包含了美国各州的人口数量和谋杀率,单位 ...
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.

Read now

Unlock full access

More than 5,000 organizations count on O’Reilly

AirBnbBlueOriginElectronic ArtsHomeDepotNasdaqRakutenTata Consultancy Services

QuotationMarkO’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.
Julian F.
Head of Cybersecurity
QuotationMarkI wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.
Addison B.
Field Engineer
QuotationMarkI’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.
Amir M.
Data Platform Tech Lead
QuotationMarkI'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.
Mark W.
Embedded Software Engineer

You might also like

基于Python的智能文本分析

基于Python的智能文本分析

Benjamin Bengfort, Rebecca Bilbro, Tony Ojeda
Python数据处理

Python数据处理

Jacqueline Kazil, Katharine Jarmul
精通機器學習

精通機器學習

Aurélien Géron
C++语言导学(原书第2版)

C++语言导学(原书第2版)

本贾尼 斯特劳斯特鲁普

Publisher Resources

ISBN: 9787115493668