© Subhashini Chellappan, Dharanitharan Ganesan 2018
Subhashini Chellappan and Dharanitharan GanesanPractical Apache Sparkhttps://doi.org/10.1007/978-1-4842-3652-9_6

6. Spark Structured Streaming

Subhashini Chellappan1  and Dharanitharan Ganesan2
(1)
Bangalore, India
(2)
Krishnagiri, Tamil Nadu, India
 

In the previous chapter, you learned the concepts of Spark Streaming and stateful streaming. In this chapter, we are going to discuss structured stream processing built on top of the Spark SQL engine.

The recommended background for this chapter is to have some prior experience with Scala. Some familiarity with the command line is beneficial. The mandatory prerequisite for this chapter is completion of the previous chapters assuming that you have practiced ...

Get Practical Apache Spark: Using the Scala API now with O’Reilly online learning.

O’Reilly members experience live online training, plus books, videos, and digital content from 200+ publishers.