10. Ingestion through structured streaming
This chapter covers
- Understanding streaming
- Building your first streaming ingestions
- Capturing the various sources of data in streaming
- Building an application that takes two streams
- Differentiating discretized streaming and structured streaming
Look at your data from a few thousand meters (or feet, if you are stuck with the imperial system) and focus on the data-generation part. Do you see systems that generate batches of data, or do you see systems that generate data continuously? Systems delivering a flow of data, also known as streams , were less popular a few years ago. Streams are definitely getting more traction, and understanding streams is the focus of this chapter.
Your mobile phone regularly ...
Get Spark in Action, Second Edition now with the O’Reilly learning platform.
O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.
