Spark in Action

List of Figures

Chapter 1. Introduction to Apache Spark

Figure 1.1. A word-count program demonstrates Spark’s conciseness and simplicity. The program is shown implemented in Hadoop’s MapReduce framework on the left and as a Spark Scala program on the right.

Figure 1.2. Main Spark components and various runtime interactions and storage options

Figure 1.3. Storing a 300 MB log file in a three-node Hadoop cluster

Figure 1.4. Loading a text file from HDFS

Figure 1.5. Filtering the collection to contain only lines containing the OutOfMemoryError string

Figure 1.6. Basic infrastructure, interface, analytic, and management tools in the Hadoop ecosystem, with some of the functionalities that Spark incorporates or makes obsolete

Chapter 3. Writing Spark ...