7 Topics and partitions
This chapters covers
- Creation parameters and configuration options
- How partitions exist as log files
- How segments impact data inside partitions
- Testing with
EmbeddedKafkaCluster
- Topic compaction and how data can be retained
In this chapter, we will look further into how we might store our data across topics as well as how to create and maintain topics. This includes how partitions fit into our design considerations and how we can view our data on the brokers. All of this information will help us as we also look at how to make a topic update data rather than appending it to a log.
7.1 Topics
To quickly refresh our memory, it is important to know that a topic is a non-concrete concept rather than a physical structure. ...
Get Kafka in Action now with the O’Reilly learning platform.
O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.