November 2017
Intermediate to advanced
328 pages
6h 51m
Japanese
Content preview from 入門 PySpark ―PythonとJupyterで活用するSpark 2エコシステム
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.
1
章
Spark
を理解する
1
1
章
Spark
を理解する
Apache Spark は、もともと Matei Zaharia がUC バークレー在籍中に博士号論文の一部として開発
した強力なオープンソースの処理エンジンです。Spark の最初のバージョンは 2012 年にリリースされ、
2013 年には ZahariaはDatabricksを 共 同 創 業 し 、そ の CTOとなりました。彼は MIT からスタンフォー
ドに移り、教授にもなっています。同時に、Spark のコードベースは Apache Software Foundationに
寄贈され、その主力プロジェクトとなりました。
Apache Spark は高速で使いやすいフレームワークであり、半構造化データ、構造化データ、ストリー
ミングデータ、そして機械学習やデータサイエンスなど、広範囲にわたる複雑なデータの問題の解決に
利用できます。また、Apache Sparkにはコントリビューターとして世界中の 570 以上の地域にわたる
250 以上の組織と300,000 人を超えるSparkミートアップのコミュニティメンバーから 1,000 人以上が
参加しており、Sparkのコミュニティはビッグデータにおける最大のオープンソースコミュニティの一つ
にもなりました。
本章は、Apache Spark を理解するための入門編です。Spark のジョブや APIの背景にある概念を解
説し、Spark 2.0のアーキテクチャを紹介し、Spark ...
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.
Read now
Unlock full access
More than 5,000 organizations count on O’Reilly
O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.Julian F.
I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.Addison B.
I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.Amir M.
I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.