Chapter 3. Topology design

This chapter covers

  • Decomposing a problem to fit Storm constructs
  • Working with unreliable data sources
  • Integrating with external services and data stores
  • Understanding parallelism within a Storm topology
  • Following best practices for topology design

In the previous chapter, we got our feet wet by building a simple topology that counts commits made to a GitHub project. We broke it down into Storm’s two primary components—spouts and bolts—but we didn’t concern ourselves with details as to why. This chapter expands on those basic Storm concepts by showing you how to think about modeling and designing solutions with Storm. You’ll learn strategies for problem analysis that can help you end up with a good design: ...

Get Storm Applied now with the O’Reilly learning platform.

O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.