O'Reilly logo

Learning Real-time Processing with Spark Streaming by Sumit Gupta

Stay ahead with the world's most comprehensive technology and business learning platform.

With Safari, you learn the way you learn best. Get unlimited access to videos, live online training, learning paths, books, tutorials, and more.

Start Free Trial

No credit card required

Summary

Throughout this chapter, we have gone through the various concepts and installation procedures of Spark and its various other components. We have also written our first Spark job in Scala and Java and executed the same in distributed mode. At the end we also discussed solutions for fixing common problems encountered during the setup of the Spark cluster.

In the next chapter, we will talk about the architecture of Spark and Spark Streaming and will also write and execute Spark Streaming examples.

With Safari, you learn the way you learn best. Get unlimited access to videos, live online training, learning paths, books, interactive tutorials, and more.

Start Free Trial

No credit card required