Skip to Content
面向数据科学家的实用统计学
book

面向数据科学家的实用统计学

by Peter Bruce, Andrew Bruce
October 2018
Beginner to intermediate
238 pages
6h 32m
Chinese
Posts & Telecom Press
Content preview from 面向数据科学家的实用统计学
38
|
第
2
章
下一步,我们要指定抽样过程。抽样可以是“随机选取
100
名客户”。当涉及对某个数据
流的抽样时,如实时客户交易、
Web
访问者等,时间上的考虑很重要,例如工作日上午十
点的
Web
访问者可能不同于周末晚上十点的
Web
访问者。
采用
分层抽样
时,我们将总体分成多个
层
,并在每一层中做随机抽样。例如,在一次政治
民意调查中,可能需要了解美国白人、非裔美国人和拉美裔美国人的选举倾向。如果我们
对总体做一次基本的随机抽样,得到的样本中可能非裔和拉美裔美国人人数过少。因此在
分层抽样中,需要对不同的层赋予不同的权重,以生成对等的抽样规模。
2.1.3
 数据规模与数据质量
:
何时规模更重要
在大数据时代,令人惊讶的是,有时数据规模越小,结果反而更好。在随机抽样上花费些
时间和精力,不仅可以减小偏差,还能让我们更关注于数据探索和数据质量。例如,在缺
失的数据和离群值中,可能包含了一些有用的信息。要从上百万条记录中查找缺失值或评
估离群值,成本可能会非常高,但是对于具有数千条记录的样本,这些事情则是完全可行
的。此外,如果数据量过大,也无法开展数据绘图和人工检测。
那么,在什么情况下需要大量的数据呢?
Google
检索查询请求,就是一个体现大数据价值的经典场景,其中数据不仅规模很大,而
且十分稀疏。如果以每个词为列、每个搜索查询为行,这样可以构建一个矩阵。矩阵中
每个单元的值为
0
或
1
,表示相应的查询中是否包含对应的词汇。我们的目标是对一个查
询给出一个最优的搜索目标。但是,英语中有
15
万多个单词,而
Google
每年会处理大约 ...
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.

Read now

Unlock full access

More than 5,000 organizations count on O’Reilly

AirBnbBlueOriginElectronic ArtsHomeDepotNasdaqRakutenTata Consultancy Services

QuotationMarkO’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.
Julian F.
Head of Cybersecurity
QuotationMarkI wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.
Addison B.
Field Engineer
QuotationMarkI’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.
Amir M.
Data Platform Tech Lead
QuotationMarkI'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.
Mark W.
Embedded Software Engineer

You might also like

基于Python的智能文本分析

基于Python的智能文本分析

Benjamin Bengfort, Rebecca Bilbro, Tony Ojeda
Python数据处理

Python数据处理

Jacqueline Kazil, Katharine Jarmul
精通機器學習

精通機器學習

Aurélien Géron
C++语言导学(原书第2版)

C++语言导学(原书第2版)

本贾尼 斯特劳斯特鲁普

Publisher Resources

ISBN: 9787115493668