August 2015
Intermediate to advanced
312 pages
7h 28m
Japanese
Content preview from 初めてのSpark
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.
251
A.4 バージョン 1.3.0 の主な変更内容
• SPARK-5655:
［バグ修正］セキュリティ設定が有効な場合にシャッフル処理中のファイル
アクセスに失敗する不具合の修正
A.3.2
PySpark
• SPARK-6667:
［バグ修正］安定性の向上
• SPARK-5973:
［バグ修正］
zip
が失敗する不具合の修正
• SPARK-6055:
［バグ修正］
PySpark
利用時の
Spark SQL
のメモリリークの修正
• SPARK-5363:
［バグ修正］大きなサイズのブロードキャスト変数を利用するときにハング
アップする不具合の修正
A.4
バージン
1.3.0
のな
本バージョンアップでは、新しい機能を含む機能改善が行われました。また
DataFrame API
が
新たに登場し、
Spark SQL
が
alpha
版を卒業しました。
MLlib
では多数のアルゴリズムが加わり、
Spark Streaming
ではダイレクト
Kafka API
が加わりました。
A.4.1
Spark
コア
• SPARK-5430:
［機能改善］負荷の高い
reduce
オペレーションを想定したマルチレベルの
アグリゲーションを
MLlib
からコアに移動
• SPARK-5063:
［機能改善］
SparkContext
の状態が
stopped
であることを示すエラーメッ
セージ出力の改善
• SPARK-3996:
［機能改善］
Jetty
サーバの中で
Spark
を利用するときにバージョン衝突す
る問題を回避するための
Jetty
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.
Read now
Unlock full access
More than 5,000 organizations count on O’Reilly
O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.Julian F.
I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.Addison B.
I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.Amir M.
I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.