August 2015
Intermediate to advanced
312 pages
7h 28m
Japanese
Content preview from 初めてのSpark
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.
121
7
クラタの
7.1
イントクン
ここまでは、
Spark
を学ぶ方法として、
Spark
シェルと、
Spark
のローカルモードで実行するサ
ンプルを使う方法に焦点を当ててきました。
Spark
でアプリケーションを書くメリットの
1
つは、
クラスタモードでそのプログラムを動作させれば、マシンを追加することによって処理をスケール
させられるようになることです。ありがたいことに、クラスタ上で並列に実行されるアプリケー
ションを書く場合でも、使う
API
はこれまで本書で学んできたものと同じです。これまで書いて
きたサンプルやアプリケーションは、そのままでクラスタ上でも動作します。これは
Spark
の高
レベル
API
のメリットの
1
つです。ユーザーは、ローカルで小さなデータセットを使ってアプリ
ケーションのプロトタイプをすばやく構築すれば、そのコードをそのまま修正することなく、きわ
めて大規模なクラスタ上で実行することさえできるのです。
本章では、まず
Spark
の分散アプリケーションのランタイムアーキテクチャを説明し、続いて
分散クラスタで
Spark
を動作させる際の選択肢について議論します。
Spark
は、オンプレミスで
もクラウドでも、数多くのクラスタマネージャ（
Hadoop
の
YARN
、
Apache
の
Mesos
、
Spark
自
身に組み込まれている
Standalone
クラスタマネージャ）上で動作させることができます。本章で
は、それぞれのケースのトレードオフと、動作させるのに必要な設定について議論します。その際 ...
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.
Read now
Unlock full access
More than 5,000 organizations count on O’Reilly
O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.Julian F.
I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.Addison B.
I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.Amir M.
I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.