O'Reilly logo

Learning Real-time Processing with Spark Streaming by Sumit Gupta

Stay ahead with the world's most comprehensive technology and business learning platform.

With Safari, you learn the way you learn best. Get unlimited access to videos, live online training, learning paths, books, tutorials, and more.

Start Free Trial

No credit card required

Summary

In this chapter, we have discussed the challenges and programming paradigms for batch and real-time data processing. We also discussed the need for frameworks like Spark and its differences with preexisting frameworks like Hadoop. At the end, we developed and deployed our first Spark Streaming program.

In the next chapter, we will talk about Spark Client APIs and some of its integral components. We will also introduce a real-world use case for distributed data processing in real time.

With Safari, you learn the way you learn best. Get unlimited access to videos, live online training, learning paths, books, interactive tutorials, and more.

Start Free Trial

No credit card required