A physical view of a Storm cluster

The next figure explains the physical position of each process. There can be only one Nimbus. However, more than one Zookeeper is there to support failover, and per machine, there is one supervisor.

A physical view of a Storm cluster

Stream grouping

A stream grouping controls the flow of tuples between from spout to bolt or bolt to bolt. In Storm, we have four types of groupings. Shuffle and field grouping are most commonly used:

  • Shuffle grouping: Tuple flow between two random tasks in this grouping
  • Field grouping: A tuple with a particular field key is always delivered to the same task of the downstream bolt
  • All grouping: Sends the same tuple to all ...

Get Building Python Real-Time Applications with Storm now with the O’Reilly learning platform.

O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.