Spark in Action, Second Edition

Appendix P. Reference for streaming

This appendix contains reference material for streaming. Ingestion via streaming is covered in chapter 10. This appendix extends and summarizes key information from the Spark reference documentation at http://mng.bz/RAMZ.

Lab Examples from this appendix are available in GitHub at https://github.com/jgperrin/net.jgp.books.spark.ch10 .

P.1 Output mode

The output mode will tell the query how to behave when it receives new data. Table P.1 provides details of the output modes. The reference can be found in Spark’s Javadoc at http://mng.bz/2XWg .

Table P.1 Output modes for streaming queries

Output mode	Constant	Description
Append (default)	OutputMode.Append ()	Only the new rows are added ...