August 2015
Intermediate to advanced
312 pages
7h 28m
Japanese
Content preview from 初めてのSpark
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.
256
付録 A 原書発行以降の変更点
不具合の修正
• SPARK-6737:
［バグ修正］
OutputCommitter
関連のメモリリークの修正
• SPARK-6313:
［バグ修正］
Spark
のワーキングディレクトリに
NFS
を利用しているとき
の不具合の修正
• SPARK-6414:
［バグ修正］ジョブキャンセル時の不具合の修正
A.5.2
Spark SQL
• SPARK-6250:
［バグ修正］
DDL
内で予約語を使用できなかった不具合の修正
• SPARK-6575, 8651, 6315, 6330:
［バグ修正］
Parquet
に関するいくつかの不具合の修正
A.5.3
Spark Streaming
• SPARK-6222:
［バグ修正］
WAL
によるリカバリでデータロスの可能性の修正
A.5.4
PySpark
• SPARK-6667:
［バグ修正］コネクション関連のバグ修正
A.6
バージン
1.4.0
のな
新機能を含む大幅な機能改善が行われました。
特に注目したいのは、
Tungsten
というプロジェクト名で進められている性能改善の取り組みで
す。その一部が
Spark
コアに取り入れられ、利用できるようになりました。また、
DataFrame
で
はユーザーの利用できる機能が豊富になり、
Spark ML
ではいくつか機能が追加されました。
A.6.1
SparkR
•
［機能改善］本バージョンで初めて導入
A.6.2
Spark
コア
• SPARK-6942:
［機能改善］
RDD
の
DAG
の可視化とイベントのタイムラインビューの追加 ...
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.
Read now
Unlock full access
More than 5,000 organizations count on O’Reilly
O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.Julian F.
I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.Addison B.
I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.Amir M.
I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.