Chapter 5. The Broker - Apache Kafka
The aim of this chapter is to familiarize the reader with Apache Kafka and show you how to solve the consumption of millions of messages in pipeline architecture. Here we show some Scala examples to give you a foundation for the different types of implementation and integration for Kafka producers and consumers.
In addition to the explanation of the Apache Kafka Architecture and principles, we'll explore the Kafka integration with the rest of the SMACK stack, specifically with Spark. At the end of the chapter, we will learn how to administrate Apache Kafka.
This chapter has the following sections:
- Introducing Kafka
- Installation
- Cluster
- Architecture
- Producers
- Consumers
- Integration
- Administration
Introducing Kafka
Jay Kreps, ...
Get Fast Data Processing Systems with SMACK Stack now with the O’Reilly learning platform.
O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.
