Hands-On Data Science and Python Machine Learning

Components of Spark

Spark actually has many different components that it's built up of. So there is a Spark Core that lets you do pretty much anything you can dream up just using Spark Core functions alone, but there are these other things built on top of Spark that are also useful.

• Spark Streaming: Spark Streaming is a library that lets you actually process data in real time. Data can be flowing into a server continuously, say, from weblogs, and Spark Streaming can help you process that data in real time as you go, forever.
• Spark SQL: This lets you actually treat data as a SQL database, and actually issue SQL queries on it, which is kind ...