5. Building a simple app for deployment

This chapter covers

  • Building a simple application that will not require data ingestion
  • Using Java lambdas with Spark
  • Building an application with or without lambdas
  • Interacting with Spark in local mode, cluster mode, and interactively
  • Calculating an approximation of π by using Spark

In the previous chapters, you discovered what Apache Spark is and how to build simple applications, and, hopefully, understood key concepts including the dataframe and laziness. Chapters 5 and 6 are linked: you will build an application in this chapter and deploy it in chapter 6.

In this chapter, you will start from scratch by building an application. You built applications previously in this book, but they always needed ...

Get Spark in Action, Second Edition now with the O’Reilly learning platform.

O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.