랜덤 포레스트는 특히 특성을 선택해야 할 때 어떤 특성이 중요한지 빠르게 확인할 수 있어 매
우 편리합니다.
7.5
부스팅
부스팅
boosting
(원래는 가설 부스팅
hypothesis
boosting
이라 불렀습니다)은 약한 학습기를 여러 개
연결하여 강한 학습기를 만드는 앙상블 방법을 말합니다. 부스팅 방법의 아이디어는 앞의 모델
을 보완해나가면서 일련의 예측기를 학습시키는 것입니다. 부스팅 방법에는 여러 가지가 있지
만 가장 인기 있는 것은 아다부스트
AdaBoost
19
(
Adaptive
Boosting
의 줄임말)와 그래디언트
부스팅
Gradient
Boosting
입니다. 아다부스트부터 시작해보죠.
7.5.1
아다부스트
이전 예측기를 보완하는 새로운 예측기를 만드는 방법은 이전 모델이 과소적합했던 훈련 샘플
19
「
A
Decision
-
Theoretic
Generalization
of
On
-
Line
Learning
and
an
Application
to
Boosting
」,
Yoav
Freund
,
Robert
E
.
Schapire
(
1997
),
http
://
goo
.
gl
/
OIduRW
254
1
부
머신러닝
의 가중치를 더 높이는 것입니다. ...
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month, and much more.
O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.
Julian F.
Head of Cybersecurity
I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.
Addison B.
Field Engineer
I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.
Amir M.
Data Platform Tech Lead
I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.