Kafka Connect

Part III. Running Kafka Connect in Production

The third part of this book focuses on running and operating Kafka Connect clusters. It is aimed at site reliability engineers (SREs) whose role is to keep data pipelines working. It describes the main concepts to understand when setting up Kafka Connect clusters, and the worker plug-ins you can use to customize them.

It covers topics such as scalability, common operation procedures, and the management REST API. It also details all the configuration options available, and the methods and best practices for monitoring pipelines via logs and metrics. Finally, it explores the considerations required to effectively run Kafka Connect clusters on Kubernetes.