January 2018
Beginner to intermediate
234 pages
7h 8m
Chinese
Content preview from Kafka权威指南
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.
跨集群数据镜像
｜
135
8.4.2
Confluent
的
Replicator
在优步开发
uReplicator
的同时，
Confluent
也开发了他们的
Replicator
。除了名字有点相似
外，它们之间没有任何共同点，所要解决的问题也不一样。
Replicator
为
Confluent
的企业
用户解决了他们在使用
MirrorMaker
进行多集群部署时所遇到的问题。
分散的集群配置
MirrorMaker
只能做到源集群和目标集群之间的数据同步，而主题可以有不同的分区、
不同的复制系数和不同的配置。如果将源集群的保留时间从
1
周改为
3
周，但忘记给灾
备集群也做同样的修改，一旦灾备集群发生了失效备援，就会丢失几周的数据。通过手
动的方式对所有配置进行同步很容易出错，而且如果系统出现了不同步，会导致下游的
应用或者镜像进程失效。
在集群管理方面所面临的挑战
MirrorMaker
一般是以多实例的集群方式进行部署的，这意味着它本身也需要进行部署、
监控和配置管理。两个配置文件和大量的配置参数让
MirrorMaker
的配置管理变得极具
挑战性。如果集群超过了两个，而且集群间的复制是双向的，那么情况会更加严峻。如
果有
3
个双活集群，就有
6
个
MirrorMaker
集群需要进行部署、监控和配置，而且每个
集群至少需要
3
个实例。如果有
5
个双活集群，就需要
20
个
MirrorMaker
集群。
为了减轻
IT
部门的负担，
Confluent
将
Replicator
实现为
Connect
的源连接器，从
Kafka
集群读取数据，而不是从数据库读取。在第 ...
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.
Read now
Unlock full access
More than 5,000 organizations count on O’Reilly
O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.Julian F.
I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.Addison B.
I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.Amir M.
I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.