O'Reilly logo

Building Python Real-Time Applications with Storm by Barry Hart, Kartik Bhatnagar

Stay ahead with the world's most comprehensive technology and business learning platform.

With Safari, you learn the way you learn best. Get unlimited access to videos, live online training, learning paths, books, tutorials, and more.

Start Free Trial

No credit card required

Running the topology – the Redis case

We have a few more small things to address before we run the topology:

  1. Copy the logconfig.ini file from the second example in Chapter 3, Introducing Petrel, to this topology's directory.
  2. Create a file called setup.sh. Petrel will package this script with the topology and run it at startup. This script installs the third-party Python libraries used by the topology. The file looks like this:
    pip install -U pip
    pip install nltk==3.0.1 oauthlib==0.7.2
    tweepy==3.2.0
  3. Create a file called manifest.txt with these two lines:
    logconfig.ini
    setup.sh
  4. Install the Redis server on a well-known node. All workers will store state here:
             sudo apt-get install redis-server
  5. Install the Python Redis client on all Storm worker machines: ...

With Safari, you learn the way you learn best. Get unlimited access to videos, live online training, learning paths, books, interactive tutorials, and more.

Start Free Trial

No credit card required