Consumer group
You can have multiple consumers for the same topic in a consumer group. If you have the same number of consumers and partitions in a group, each consumer will read only one partition. This allows parallelizing the consumption. If you have more consumers than partitions, the first consumer takes the partition and the rest of the consumers are in waiting mode. They will consume only if a consumer reading on a partition is failing.
Until now, we only have one group of consumers reading from partitions. In a typical system, you would have many consumer groups. For example, in the case of a Bitcoin transaction, we could have a consumer group reading the messages to perform analytics on it, and another group for a user interface ...
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.
Read now
Unlock full access