Kafka Troubleshooting in Production: Stabilizing Kafka Clusters in the Cloud and On-premises

Index

A

Aggregation

Antiviruses scans files

Average Batch Size metrics

grouping message

higher values

low average batch size

migration

potential reasons/negative effects

producer pods

Avg/Max fetch request metrics

fetch.max.bytes/max.partition.fetch.bytes

fetch performance

fundamental issue

high values

low value

B

Buffer available bytes metrics

Bytes Consumed Rate metrics

C

Cardinality data

SeeData cardinality

Central processing unit (CPU)

cost optimization strategies

cost reduction

optimization strategies

strategic role

utilization

See alsoCPU saturation

Clusters

consumer monitoring

cost reduction

disk I/O data

follower skew

JBOD configuration

partition leader

producer monitoring

RAM

SeeRandom access memory (RAM)

storage disks

cloud

EBS ...