Chapter 8. Storm internals
This chapter covers
- How an executor works under the covers
- How tuples are passed between executors
- Storm’s internal buffers
- Overflow and tuning of Storm’s internal buffers
- Routing and tasks
- Storm’s debug log output
Here we are, four chapters into covering Storm in production. We’ve explained how you can use the Storm UI to understand what’s going on in your topologies, how to use that information to tune your topologies, and how to diagnose and treat cross-topology contention issues. We’ve explored a number of tools you can put to good use. In this chapter, we’ll introduce you to one more: a deeper understanding of Storm’s internals.
Why do we think this is important? Well, in the previous three chapters ...