Kafka Troubleshooting in Production: Stabilizing Kafka Clusters in the Cloud and On-premises

© The Author(s), under exclusive license to APress Media, LLC, part of Springer Nature 2023

E. EldorKafka Troubleshooting in Production https://doi.org/10.1007/978-1-4842-9490-1_5

5. CPU Saturation in Kafka: Causes, Consequences, and Solutions

Elad Eldor¹  

(1)

Tel Aviv, Israel

 

CPU Saturation

CPU Usage Types

Causes of High CPU User Times

Causes of High CPU System Times

Example of Kafka Brokers with High CPU %us and %sy

Causes of High CPU Wait Times

Causes of High CPU System Interrupt Times

The Effect of Compacted Topics with High Retention on Disk and CPU Use

What Is Log Compaction?

Real Production Issues Due to Log Compaction

The Number of Consumers per Topic vs. CPU Use

Summary

There are cases in which CPU saturation can cause the Kafka cluster to delay consumers ...