Deployment and monitoring

In this section, we will discuss the various methodologies for deploying and monitoring Spark Streaming applications. Deployment and monitoring is a vast topic and it becomes complex when we talk about distributed deployments and monitoring. Discussing all aspects of Spark deployment is out of the scope of this book, but we will touch upon the various aspects of deployments and monitoring which will help us to understand the various features and flexibility provided by Spark and Spark Streaming.

Cluster managers for Spark Streaming

Spark is a framework that does not enforce any app servers or deployment stack. Spark provides the integration and deployment of Spark and Spark-based applications on various distributed cluster ...

Get Real-Time Big Data Analytics now with O’Reilly online learning.

O’Reilly members experience live online training, plus books, videos, and digital content from 200+ publishers.