November 2017
Intermediate to advanced
328 pages
6h 51m
Japanese
Content preview from 入門 PySpark ―PythonとJupyterで活用するSpark 2エコシステム
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.
14
1
章
Spark
を理解する
機能も持っています。
1.3.5
継続的アプリケーション
これらすべてをまとめると、Apache Spark 2.0はDataFrameとDataset を統合したのみならず、ス
トリーミング、インタラクティブ、バッチといった種類のクエリも統合しました。これはたとえば、多
くのシナリオのさまざまなレイテンシの条件の下でデータをストリームに集約し、それを従来の JDBC/
ODBC 経由で提供し、クエリを実行時に変化させ、機械学習のモデルの構築と適用を行うような、まっ
たく新しいユースケースへの扉を開くものです。
目標：エンドツーエンドの連続的なアプリケーション
その他の種類の処理
トランザクション処理を行うストリーム
ア プリケ ー ション
例
データベース
機械学習の
モデル
アドホックなクエリ
レポ ー ティング
Apache Spark Key Terms, Explained（https://databricks.com/blog/2016/06/22/apache-spark-key-terms-
explained.html）
これらをまとめることで、エンドツーエンドの継続的アプリケーションを構築できるようになりまし
た。そういったアプリケーションでは、同じクエリをバッチ処理と同じくリアルタイムデータにも発行で
き、ETL の実行やレポートの生成、そしてストリーム中の特定データの更新や追跡が行えるのです。
継続的アプリケーションに関する詳しい情報については、
Matei Zaharia ...
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.
Read now
Unlock full access
More than 5,000 organizations count on O’Reilly
O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.Julian F.
I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.Addison B.
I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.Amir M.
I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.