September 2017
Beginner to intermediate
360 pages
8h 13m
English
Spark Streaming is a very useful extension to the Spark core API that's being widely used to process incoming streaming data in real-time or close to real-time as in near real-time (NRT). This API extension has all the core Spark features in terms of highly distributed, scalable, fault tolerant, and high throughput, low latency processing.
The following diagram captures how Spark Streaming works in close conjunction with the Spark execution engine to process real-time data streams:

Spark Streaming works on microbatching based architecture --we can envision it as an extension to the core Spark ...
Read now
Unlock full access