© Zubair Nabi 2016

Zubair Nabi, Pro Spark Streaming, 10.1007/978-1-4842-1479-4_3

3. DStreams: Real-Time RDDs

Zubair Nabi

(1)Lahore, Pakistan

Always in motion is the future.

—Grand Jedi Master Yoda, Star Wars Episode V: The Empire Strikes Back

According to IBM, 60% of all sensory information loses value in a few milliseconds if it is not acted on.1 Bearing in mind that the Big Data and analytics market has reached $125 billion and a large chunk of this will be attributed to IoT in the future,2 the inability to tap real-time information will result in a loss of billions of dollars. Examples of some of these applications include a telco working out how many of its users have used Whatsapp in the last 30 minutes, a retailer keeping track of the number ...

Get Pro Spark Streaming: The Zen of Real-Time Analytics Using Apache Spark now with the O’Reilly learning platform.

O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.