August 2015
Intermediate to advanced
312 pages
7h 28m
Japanese
Content preview from 初めてのSpark
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.
223
11.3 機械学習の基礎
Linux
のパッケージマネージャで
python-numpy
もしくは
numpy
パッケージをインストールするか、
Anaconda
（
http://continuum.io/downloads
）のようなサードパーティの科学計算用の
Python
の
インストーラを使うのが、もっとも簡単な入手方法です。
MLlib
がサポートしているアルゴリズムは、時間と共に進歩もしています。本章で議論するアル
ゴリズム群は、すべて
Spark 1.2
で利用できますが、中にはそれ以前のバージョンにはなかったも
のもあります。
11.3
の
MLlib
の関数群を見ていくために、まずは機械学習の概念を簡単に振り返っておきましょう。
機械学習のアルゴリズム群は、ーーに基づいて予測や判断を試み、しばしばアル
ゴリズムの振る舞いに関する数学的な目標を最大化します。学習の課題には、分類、回帰、クラス
タリングといった種類があり、それぞれに異なる目的があります。シンプルな例として、を考
えてみましょう。分類では、ラベル付けされた他のアイテムのサンプル（例えばスパムであった
り、スパムでないことがわかっているメール）に基づき、あるアイテムがいくつかのカテゴリのど
れに属するのかを特定することが求められます。
すべての学習アルゴリズムでは、それぞれのアイテムに対して特徴の集合を定義することが必要
であり、この特徴の集合が学習関数に渡されることになります。メールを例に取れば、メールの送
信元のサーバー、 ...
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.
Read now
Unlock full access
More than 5,000 organizations count on O’Reilly
O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.Julian F.
I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.Addison B.
I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.Amir M.
I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.