Industrial Internet Application Development

Developing streaming analytics using Spark

In this section, we will discuss the steps required in developing a streaming analytics using Spark and Kafka.

Kafka is a streaming platform for real time message streaming. It is a highly scalable distributed platform that enables the client and servers to publish and subscribe for messages.

Spark has a Kafka connector that supports real-time streaming analysis. It supports the analysis of the incoming stream for anomaly detection or any other use cases for real time notifications and alerts in mission-critical events.