O'Reilly logo

Learning Real-time Processing with Spark Streaming by Sumit Gupta

Stay ahead with the world's most comprehensive technology and business learning platform.

With Safari, you learn the way you learn best. Get unlimited access to videos, live online training, learning paths, books, tutorials, and more.

Start Free Trial

No credit card required

Architecture of Spark Streaming

In the previous section we discussed Spark, highlighting the position of Spark Streaming in the overall architecture of Spark. In this section we will discuss the various components and architecture of Spark Streaming.

What is Spark Streaming?

Spark Streaming is an interesting and powerful extension of Spark which provides the processing of streaming data or fast moving data (http://en.wikipedia.org/wiki/Stream_(computing)) in near real-time.

There are many applications and use cases like spam filtering, intrusion detection, and clickstream data analysis which generates live data in milliseconds and further to make it more complex it needs to be analyzed at the same time and produce results.

Spark already provided a ...

With Safari, you learn the way you learn best. Get unlimited access to videos, live online training, learning paths, books, interactive tutorials, and more.

Start Free Trial

No credit card required