O'Reilly logo

Storm Blueprints: Patterns for Distributed Real-time Computation by Brian O'Neill, P. Taylor Goetz

Stay ahead with the world's most comprehensive technology and business learning platform.

With Safari, you learn the way you learn best. Get unlimited access to videos, live online training, learning paths, books, tutorials, and more.

Start Free Trial

No credit card required

Implementing the architecture

With the design in place, we can turn our attention to the implementation. The sequence diagram for the implementation is shown as follows:

Implementing the architecture

The preceding diagram implements the state machine shown in the design. Once the real-time server is started, Druid polls the StormFirehose object using the hasMore() method. The contract with Druid specifies that the Firehose object's implementation should block until data is available. While Druid is polling and the Firehose object is blocking, Storm delivers tuples into the DruidState object's message buffer. When the batch is complete, Storm calls the commit() method on the ...

With Safari, you learn the way you learn best. Get unlimited access to videos, live online training, learning paths, books, interactive tutorials, and more.

Start Free Trial

No credit card required