Skip to Content
面向数据科学家的实用统计学
book

面向数据科学家的实用统计学

by Peter Bruce, Andrew Bruce
October 2018
Beginner to intermediate
238 pages
6h 32m
Chinese
Posts & Telecom Press
Content preview from 面向数据科学家的实用统计学
204
|
第
7
章
pct_var <- data.frame(pct_var = 0,
num_clusters=2:14)
totalss <- kmeans(df, centers=14, nstart=50, iter.max = 100)$totss
for(i in 2:14){
pct_var[i-1, 'pct_var'] <- kmeans(df, centers=i, nstart=50, iter.max = 100)
$betweenss/totalss
}
要评估应保留的类数,最重要的检验也许是:类是否可复用于新的数据?类是否可解释?
类反映了数据的一般特性,还是仅仅反映了特定的实例?这在某种程度上可以使用交叉验
证进行评估,参见
4.2.3
节。
一般来说,并不存在能可靠地指导所生成的类数的单一规则。
对于确定类数,存在多种更正式的方法,这些方法均基于统计学或信息理
论。例如,罗伯特
•
蒂希雷尼、冈瑟
•
瓦尔特(
Guenther Walther
)和特雷弗
•
哈斯蒂基于统计理论提出了一种“间隙”(
gap
)统计量,用来识别肘部。但
是对于大多数的应用而言,可能没有必要甚至不适合应用这些理论方法。
本节要点
•
所需的类数
K
由用户决定。
•
K
-Means
算法通过迭代地将记录分配给最近的类均值,直到类的分配情况不再发生
改变,实现了类的生成。
•
通常,出于实际的考虑决定了
K
的选择。在统计学上不存在最优的类数。
7.3
 层次聚类
除
K
-Means
以外,
层次聚类
(
hierarchical clustering ...
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.

Read now

Unlock full access

More than 5,000 organizations count on O’Reilly

AirBnbBlueOriginElectronic ArtsHomeDepotNasdaqRakutenTata Consultancy Services

QuotationMarkO’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.
Julian F.
Head of Cybersecurity
QuotationMarkI wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.
Addison B.
Field Engineer
QuotationMarkI’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.
Amir M.
Data Platform Tech Lead
QuotationMarkI'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.
Mark W.
Embedded Software Engineer

You might also like

基于Python的智能文本分析

基于Python的智能文本分析

Benjamin Bengfort, Rebecca Bilbro, Tony Ojeda
Python数据处理

Python数据处理

Jacqueline Kazil, Katharine Jarmul
精通機器學習

精通機器學習

Aurélien Géron
C++语言导学(原书第2版)

C++语言导学(原书第2版)

本贾尼 斯特劳斯特鲁普

Publisher Resources

ISBN: 9787115493668