Chapter 2. Setting Up a Storm Cluster

In the last chapter, we saw how to write a minimal Storm topology and run it on the local mode and a single-node Storm cluster. In this chapter, we will cover the following topics:

  • How to run the sample topology in a distributed Storm cluster
  • How to configure the parallelism of a topology
  • How to partition a stream using different stream grouping

In the last chapter, we saw how to set up single-node ZooKeeper to use with Storm. Even though we can proceed with the same ZooKeeper setup for a distributed Storm cluster setup, then it will be a single point of failure in the cluster. To avoid this, we are deploying a distributed ZooKeeper cluster.

It is advised to run an odd number of ZooKeeper nodes, as the ZooKeeper ...

Get Learning Storm now with O’Reilly online learning.

O’Reilly members experience live online training, plus books, videos, and digital content from 200+ publishers.