Kafka Troubleshooting in Production: Stabilizing Kafka Clusters in the Cloud and On-premises

© The Author(s), under exclusive license to APress Media, LLC, part of Springer Nature 2023

E. EldorKafka Troubleshooting in Production https://doi.org/10.1007/978-1-4842-9490-1_4

4. Dealing with Skewed and Lost Leaders

Elad Eldor¹  

(1)

Tel Aviv, Israel

 

When Partitions Lose Their Leadership

ZooKeeper

The Network Interface Card (NIC)

Should Leader Skew Always Be Solved?

When There Is High Traffic

When There Is a Large Number of Consumers/Producers

Understanding Leader Skew

Summary

This chapter explains how to detect and troubleshoot issues related to skewed or lost leaders. In Kafka, messages are produced into topics by producers. These messages are later consumed from these topics by consumers. Figure 4-1 shows a general sketch of this flow.

A flowchart ...