Storm on Mesos

Storm is a real-time distributed data processing system for processing data coming in at high velocities. It can process millions of records per second and is particularly useful for applications where millisecond-level latency is essential (for example, security threat detection, fraud detection, operational monitoring, and so on).

The Storm architecture

A typical Storm cluster has three types of nodes:

  • Nimbus or master node: This is responsible for submitting and distributing the computations for execution apart from handling tasks such as launching slave nodes and monitoring the execution
  • ZooKeeper node: This is responsible for coordinating the cluster
  • Supervisor node: This is responsible for starting and stopping slave nodes based ...

Get Mastering Mesos now with the O’Reilly learning platform.

O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.