Appendix K. Installing Spark in production and a few tips

This appendix describes the following:

  • Installing Spark under several operating systems
  • Learning about the various tools you are installing
  • Discovering key elements of the configuration

Although some of this content is presented elsewhere in the book, some of it is adapted from online content that may not be easy to find or put together. Putting it all together in a convenient place is the goal of this appendix. This appendix is up-to-date for Spark v3.

K.1 Installation

In most of the book, you will never need to install Spark because all the examples are designed to work in Spark’s local mode (see chapter 5). When you run a Spark application in local mode using Maven, Maven will download ...

Get Spark in Action, Second Edition now with the O’Reilly learning platform.

O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.