Skip to Content
面向数据科学家的实用统计学
book

面向数据科学家的实用统计学

by Peter Bruce, Andrew Bruce
October 2018
Beginner to intermediate
238 pages
6h 32m
Chinese
Posts & Telecom Press
Content preview from 面向数据科学家的实用统计学
186
|
第
6
章
算法的预测值可以使用
predict 函数得到。由于在本例中只使用了两个变量,因此只绘制
预测变量和预测值。
pred <- predict(xgb, newdata=predictors)
xgb_df <- cbind(loan3000, pred_default=pred>.5, prob_default=pred)
ggplot(data=xgb_df, aes(x=borrower_score, y=payment_inc_ratio,
color=pred_default, shape=pred_default)) +
geom_point(alpha=.6, size=2)
结果如图
6-9
所示。从定性的角度来看,算法的输出类似于图
6-7
中随机森林做出的预测。
在预测中存在一些噪声,因为有些借贷信用评分很高的借款者仍被预测为拖欠。
图 6-9:将 XGBoost 应用于贷款拖欠数据得到的预测结果
6.4.3
 正则化
:
避免过拟合
如果盲目地应用 xgboost 函数,可能会
过拟合
训练数据,进而导致模型不稳定。过拟合问
题是两方面的。
•
应用于不在训练集中的新数据时,模型的正确率会降低。
•
模型给出的预测是高度可变的,导致了结果不稳定。
任何建模技术都可能产生过拟合。例如,如果回归方程中包含了过多的变量,那么模型可
能会给出虚假预测。然而对于大多数统计技术而言,可以通过审慎地选择预测变量来避免
产生过拟合。即便是随机森林,通常也能给出一个合理的模型,而无须调整参数。但这并 ...
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.

Read now

Unlock full access

More than 5,000 organizations count on O’Reilly

AirBnbBlueOriginElectronic ArtsHomeDepotNasdaqRakutenTata Consultancy Services

QuotationMarkO’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.
Julian F.
Head of Cybersecurity
QuotationMarkI wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.
Addison B.
Field Engineer
QuotationMarkI’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.
Amir M.
Data Platform Tech Lead
QuotationMarkI'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.
Mark W.
Embedded Software Engineer

You might also like

基于Python的智能文本分析

基于Python的智能文本分析

Benjamin Bengfort, Rebecca Bilbro, Tony Ojeda
Python数据处理

Python数据处理

Jacqueline Kazil, Katharine Jarmul
精通機器學習

精通機器學習

Aurélien Géron
C++语言导学(原书第2版)

C++语言导学(原书第2版)

本贾尼 斯特劳斯特鲁普

Publisher Resources

ISBN: 9787115493668