Chapter 8. Storm internals

This chapter covers

  • How an executor works under the covers
  • How tuples are passed between executors
  • Storm’s internal buffers
  • Overflow and tuning of Storm’s internal buffers
  • Routing and tasks
  • Storm’s debug log output

Here we are, four chapters into covering Storm in production. We’ve explained how you can use the Storm UI to understand what’s going on in your topologies, how to use that information to tune your topologies, and how to diagnose and treat cross-topology contention issues. We’ve explored a number of tools you can put to good use. In this chapter, we’ll introduce you to one more: a deeper understanding of Storm’s internals.

Why do we think this is important? Well, in the previous three chapters ...

Get Storm Applied now with the O’Reilly learning platform.

O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.