Skip to Content
Kafka权威指南(第2版)
book

Kafka权威指南(第2版)

by Gwen Shapira, Todd Palino, Rajini Sivaram, Krit Petty
November 2022
Beginner to intermediate
346 pages
11h
Chinese
Posts & Telecom Press
Content preview from Kafka权威指南(第2版)
跨集群数据镜像
193
集群链接
集群链接是
Confluent
Platform 6.0
的一个预览特性,它直接将集群间复制功能放在了
Confluent Server
。集群链接将集群内的
broker
间复制协议用在了集群间复制上,可
以跨集群执行带偏移量迁移的数据复制,无须偏移量转换就可以实现客户端无缝迁移。
主题配置信息、分区、消费者偏移量和
ACL
都可以在两个集群之间保持同步
,以便在
发生灾难时实现低
RT
O
的故障转移。集群链接定义了从一个源集群到一个目标集群的
定向流。目标集群的首领
broker
从对应的源首领那里获取分区数据
,目标集群的跟随
者使用
Kafka
的标准复制机制从本地首领那里复制数据
。目标集群的镜像主题会被标记
为只读,以防止本地生产者将数据生成到这些主题上,从而确保镜像主题在逻辑上与源
主题保持一致。
集群链接提供了运维上的便利性,无须用到其他集群(如
Connect
集群)
,并且比外部
工具更加高效,因为它避免了镜像期间的解压缩和再压缩。与
MRC
同,集群链接没
有同步复制选项,而且在进行客户端故障转移时需要手动重启客户端。不过,集群链接
可用于网络不可靠且高延迟的远程数据中心,它只在数据中心之间复制一次数据,从而
减少了跨数据中心的流量。它适用于迁移集群和需要共享主题的场景。
10.5
 小结
从解释为什么需要多个
Kafka
集群开始,本章首先介绍了几种从简单到复杂的多集群架
构。然后介绍了
Kafka
故障转移的实现细节
,并比较了当前几种可用的解决方案。接下来
介绍了一些可用的工具,从
MirrorMaker ...
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.

Read now

Unlock full access

More than 5,000 organizations count on O’Reilly

AirBnbBlueOriginElectronic ArtsHomeDepotNasdaqRakutenTata Consultancy Services

QuotationMarkO’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.
Julian F.
Head of Cybersecurity
QuotationMarkI wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.
Addison B.
Field Engineer
QuotationMarkI’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.
Amir M.
Data Platform Tech Lead
QuotationMarkI'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.
Mark W.
Embedded Software Engineer

You might also like

时间序列分析实战:基于机器学习和统计学

时间序列分析实战:基于机器学习和统计学

Aileen Nielsen
Spark机器学习实战

Spark机器学习实战

Posts & Telecom Press, Siamak Amirghodsi, Meenakshi Rajendran, Broderick Hall, Shuen Mei
写给系统管理员的Python脚本编程指南

写给系统管理员的Python脚本编程指南

Posts & Telecom Press, Ganesh Sanjiv Naik
Kubernetes编程

Kubernetes编程

Michael Hausenblas, Stefan Schimanski

Publisher Resources

ISBN: 9787115601421