Skip to Content
面向数据科学家的实用统计学
book

面向数据科学家的实用统计学

by Peter Bruce, Andrew Bruce
October 2018
Beginner to intermediate
238 pages
6h 32m
Chinese
Posts & Telecom Press
Content preview from 面向数据科学家的实用统计学
156
|
第
5
章
假阳性率的困惑
假阳性率和假阴性率常与特异性或灵敏度相混淆。即便是在一些已发表的著
作和软件中,也会出现这样的错误!有时,假阳性率被定义为将真阴性检验
为阳性的比例。在很多情况下,例如在网络攻击检测中,该术语用于指阳性
信号为真阴性的比例。
5.4.6
 提升
相对于正确率而言,
AUC
度量无疑是一种改进,它可以评估一个分类器是否很好地处理了
整体正确率与识别更重要的
1
这项需求之间的权衡。但是,
AUC
并未完全解决稀有类的问
题。在稀有类问题中,为了避免将所有的记录分类为
0
,我们需要将模型的截止概率降至
0.5
以下。这时,如果要将一个记录分类为
1
,可能需要
0.4
、
0.3
或更低的截止概率。事实
上,我们最终过度识别了
1
,这表明这些数据更加重要。
更改截止值会增加捕获
1
的机会,然而代价就是将更多的
0
误分类为
1
。那么如何确定最
优的截止值?
我们可以使用
提升
(
lift
)这一概念来解答。我们考虑将记录按预测为
1
的概率进行排序。
如果算法使用了分类为
1
的概率来排序前
10%
的记录,那么相比于使用简单盲目选择的基
准,算法的效果可以提升多少?如果在排序前
10%
的记录上可以获得
0.3%
的响应,而使
用在整体范围内随机挑选的记录可以得到
0.1%
的响应,那么我们称算法在排序前
10%
上
的
提升
为
3
,也可以称
增益
(
gain
)为
3
。提升图(或增益表)定量地反映了整个数据范围
内的提升情况。该图能够以十分位数为单位生成,也可以根据整个数据范围连续生成。
要计算提升图,首先要生成
累积增益图
。在该图中,
y
轴显示的是召回率,
x
轴显示的是记 ...
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.

Read now

Unlock full access

More than 5,000 organizations count on O’Reilly

AirBnbBlueOriginElectronic ArtsHomeDepotNasdaqRakutenTata Consultancy Services

QuotationMarkO’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.
Julian F.
Head of Cybersecurity
QuotationMarkI wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.
Addison B.
Field Engineer
QuotationMarkI’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.
Amir M.
Data Platform Tech Lead
QuotationMarkI'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.
Mark W.
Embedded Software Engineer

You might also like

基于Python的智能文本分析

基于Python的智能文本分析

Benjamin Bengfort, Rebecca Bilbro, Tony Ojeda
Python数据处理

Python数据处理

Jacqueline Kazil, Katharine Jarmul
精通機器學習

精通機器學習

Aurélien Géron
C++语言导学(原书第2版)

C++语言导学(原书第2版)

本贾尼 斯特劳斯特鲁普

Publisher Resources

ISBN: 9787115493668