Skip to Content
Bad Data 技術手冊
book

Bad Data 技術手冊

by Q. Ethan McCallum
September 2013
Intermediate to advanced
264 pages
5h
Chinese
GoTop Information, Inc.
Content preview from Bad Data 技術手冊
138
|
第十章:偏頗與錯誤的微妙來源
其實是有一些策略能夠用來找出或甚至是解決其中一些偏頗,但為了怕沒有辦法能夠修
復偏頗的來源,知道這些問題可能會如何影響你的結果是很重要的。
超過上限∕超過下限
尾巴存在於任何的分佈中,而舉例來說,在工資或收入的狀況中,這些尾巴可能會很
長。為了要保護它的受訪者的資料,實施訪問的機構也許會使用單一值來將極高的值
topcoding)或是極低的值(bottomcoding)置換掉。以 Current Population Survey
CPS)當做例子,每個月由 U.S. Census Bureau 對超過 50,000 個家庭作訪問。在前幾
年, Census Bureau 會將超過上限的值以上限值替換。舉例來說,在 1996 年之前,工
資的上限設定為 $99,999,所以任何回報工資超過這個上限的人,他的工資值就會被置
換成 $99,999。這個程序的影響,就是會在該階層的工資分佈中產生一個突起。在最近
幾年, Census Bureau 會將超過一些(較高)門檻工資的值,使用類似特徵(特別是性
別、人種以及工作狀態)集合的人的平均工資來置換。
這個方法有兩個優點:第一,它不會在工資上限處產生單一的突起(儘管它會在上限之
上產生數個較小的突起);第二,不論有沒有上限,所有工資的加總會是相同的。在最
近期的 CPS 中,在上限之上的工資在受訪者之間被交換;這保留了分佈的尾巴,但這樣
也改變了工資與其他性質之間的關聯(以保護受訪者)。
若沒有存取其他的資料來源(不論是行政資料或是將上下限移除之前的原始受訪資料) ...
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.

Read now

Unlock full access

More than 5,000 organizations count on O’Reilly

AirBnbBlueOriginElectronic ArtsHomeDepotNasdaqRakutenTata Consultancy Services

QuotationMarkO’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.
Julian F.
Head of Cybersecurity
QuotationMarkI wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.
Addison B.
Field Engineer
QuotationMarkI’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.
Amir M.
Data Platform Tech Lead
QuotationMarkI'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.
Mark W.
Embedded Software Engineer

You might also like

RxJava反应式编程

RxJava反应式编程

Tomasz Nurkiewicz, Ben Christensen
高效能PYTHON程式設計

高效能PYTHON程式設計

Micha Gorelick, Ian Ozsvald
Kubernetes编程

Kubernetes编程

Michael Hausenblas, Stefan Schimanski

Publisher Resources

ISBN: 9789862768952