3

Understanding the Spark Cluster Architecture

It is not the beauty of a building you should look at; it’s the construction of the foundation that will stand the test of time.

David Allan Coe, American songwriter

In This Chapter:

Detailed overview of the Spark application and cluster components

Spark resource schedulers and Cluster Managers

How Spark applications are scheduled on YARN clusters

Spark deployment modes

Before you begin your journey ...

Get Data Analytics with Spark Using Python, First edition now with the O’Reilly learning platform.

O’Reilly members experience live online training, plus books, videos, and digital content from nearly 200 publishers.