January 2018
Beginner to intermediate
234 pages
7h 8m
Chinese
Content preview from Kafka权威指南
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.
安装
Kafka
｜
25
生产者
生产者
Kafka集群
主题A
主题A
主题B
分区0
分区1
分区0
消费者
图 2-2：一个简单的 Kafka 集群
2.6.1
需要多少个
broker
一个
Kafka
集群需要多少个
broker
取决于以下几个因素。首先，需要多少磁盘空间来保
留数据，以及单个
broker
有多少空间可用。如果整个集群需要保留
10TB
的数据，每个
broker
可以存储
2TB
，那么至少需要
5
个
broker
。如果启用了数据复制，那么至少还需要
一倍的空间，不过这要取决于配置的复制系数是多少（将在第
6
章介绍）。也就是说，如
果启用了数据复制，那么这个集群至少需要
10
个
broker
。
第二个要考虑的因素是集群处理请求的能力。这通常与网络接口处理客户端流量的能力有
关，特别是当有多个消费者存在或者在数据保留期间流量发生波动（比如高峰时段的流量
爆发）时。如果单个
broker
的网络接口在高峰时段可以达到
80%
的使用量，并且有两个
消费者，那么消费者就无法保持峰值，除非有两个
broker
。如果集群启用了复制功能，则
要把这个额外的消费者考虑在内。因磁盘吞吐量低和系统内存不足造成的性能问题，也可
以通过扩展多个
broker
来解决。
2.6.2
broker
配置
要把一个
broker
加入到集群里，只需要修改两个配置参数。首先，所有
broker
都必须配
置相同的
zookeeper.connect
，该参数指定了用于保存元数据的
Zookeeper
群组和路径。
其次，每个
broker
都必须为
broker.id
参数设置唯一的值。如果两个
broker ...
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.
Read now
Unlock full access
More than 5,000 organizations count on O’Reilly
O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.Julian F.
I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.Addison B.
I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.Amir M.
I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.