Chapter 8. Storm internals

This chapter covers

  • How an executor works under the covers
  • How tuples are passed between executors
  • Storm’s internal buffers
  • Overflow and tuning of Storm’s internal buffers
  • Routing and tasks
  • Storm’s debug log output

Here we are, four chapters into covering Storm in production. We’ve explained how you can use the Storm UI to understand what’s going on in your topologies, how to use that information to tune your topologies, and how to diagnose and treat cross-topology contention issues. We’ve explored a number of tools you can put to good use. In this chapter, we’ll introduce you to one more: a deeper understanding of Storm’s internals.

Why do we think this is important? Well, in the previous three chapters ...

Get Storm Applied: Strategies for real-time event processing now with O’Reilly online learning.

O’Reilly members experience live online training, plus books, videos, and digital content from 200+ publishers.