O'Reilly logo

Spark in Action by Petar Zečević Marko Bonaći

Stay ahead with the world's most comprehensive technology and business learning platform.

With Safari, you learn the way you learn best. Get unlimited access to videos, live online training, learning paths, books, tutorials, and more.

Start Free Trial

No credit card required

Chapter 2. Spark fundamentals

This chapter covers

  • Exploring the spark-in-action VM
  • Managing multiple Spark versions
  • Getting to know Spark’s command line interface (spark-shell)
  • Playing with simple examples in spark-shell
  • Exploring RDD actions and transformations and double functions

It’s finally time to get down to business. In this chapter, you’ll start using the VM we prepared for you and write your first Spark programs. All you need is a laptop or a desktop machine with a usable internet connection and the prerequisites described in chapter 1.

To avoid overwhelming you this early in the book with various options for running Spark, for now you’ll be using the so-called Spark standalone local cluster. Standalone means Spark is using ...

With Safari, you learn the way you learn best. Get unlimited access to videos, live online training, learning paths, books, interactive tutorials, and more.

Start Free Trial

No credit card required