August 2015
Intermediate to advanced
312 pages
7h 28m
Japanese
Content preview from 初めてのSpark
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.
72
5 章 データのロードとセーブ
ーム
NFS
、
HDFS
、
Amazon S3
といった、ローカルあるいは分散ファイルシステムに保存された
データに対しては、
Spark
はテキスト、
JSON
、
SequenceFile
、
Protocol Buffers
といった多
くのファイルフォーマットにアクセスできます。ここでは、いくつかの一般的なフォーマット
の使い方と、
Spark
からファイルシステムにアクセスし、圧縮の設定をする方法を紹介してい
きます。
Spark SQL
ーー
9
で取り上げる
Spark SQL
モジュールは、
JSON
や
Apache Hive
のような構造化データ
ソースに対する優れた
API
を提供します。この
API
は、しばしば効率の面でも優れているこ
とがあります。本章では
Spark SQL
の使い方を簡単に説明しますが、詳細の大部分は
9
に
譲ります。
ーーー
Cassandra
、
HBase
、
Elasticsearch
、
JDBC
データベースに接続するための組み込みおよび
サードパーティのライブラリを紹介していきます。
ここで紹介する方法のほとんどは、
Spark
のすべての言語で利用できますが、ライブラリの中で
は現時点で
Java
および
Scala
でしか使えないものもあります。そういった場合には、その旨を記
載しています。
5.2
フイルフーット
Spark
では、数多くのファイルフォーマットで、データのロードとセーブを非常にシンプルに行
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.
Read now
Unlock full access
More than 5,000 organizations count on O’Reilly
O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.Julian F.
I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.Addison B.
I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.Amir M.
I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.