Skip to Content
Kafka权威指南(第2版)
book

Kafka权威指南(第2版)

by Gwen Shapira, Todd Palino, Rajini Sivaram, Krit Petty
November 2022
Beginner to intermediate
346 pages
11h
Chinese
Posts & Telecom Press
Content preview from Kafka权威指南(第2版)
184
10
用它在灾备集群中找到最后的检查点偏移量。
Kafka 2.7.0
支持定时迁移消费者偏移量,
它会自动将转换后的偏移量提交到灾备集群的
__consumer_offsets
主题,消费者在切换
到灾备集群后就可以从之前停止的位置重新开始处理数据,不会发生数据丢失,并会将
重复处理消息的可能性降到最低。为安全起见,如果目标集群的消费者正在使用目标消
费者群组,那么
MirrorMaker
就不会覆盖偏移量,从而能够避免出现意外冲突。
主题配置信息和 ACL 的迁移
除了数据,
MirrorMaker
也可以镜像主题的配置信息和访问控制列表
ACL
)信息,以
便保留相同的主题行为。这个功能默认是启用的,并会以合理的时间间隔刷新。源主题
的大部分配置参数会被应用于目标主题,但有一些参数在默认情况下不会被应用,比如
min.insync.replicas
。需要排除哪些配置参数可以自行指定。
只有那些与被镜像的主题匹配的字面量
ACL
被迁移,因此,如果你使用的是包含前
缀或通配符的
ACL
者其他身份验证机制,则需要在目标集群中显式配置。为了确保
只有
MirrorMaker
能够向目标主题写入数据
Topic:Write
权限不会被迁移。在发生故
障转移时,必须显式地授予应用程序适当的访问权限,确保它们可以正常访问第二个
集群。
连接器任务
参数
tasks.max
指定了与
MirrorMaker
关联的连接器可以使用的最大任务数。默认值
1
但建议最少将其设置为
2
。在复制大量的主题分区时,为了增加并行度,应该尽
可能设置更大的值。 ...
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.

Read now

Unlock full access

More than 5,000 organizations count on O’Reilly

AirBnbBlueOriginElectronic ArtsHomeDepotNasdaqRakutenTata Consultancy Services

QuotationMarkO’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.
Julian F.
Head of Cybersecurity
QuotationMarkI wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.
Addison B.
Field Engineer
QuotationMarkI’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.
Amir M.
Data Platform Tech Lead
QuotationMarkI'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.
Mark W.
Embedded Software Engineer

You might also like

时间序列分析实战:基于机器学习和统计学

时间序列分析实战:基于机器学习和统计学

Aileen Nielsen
Spark机器学习实战

Spark机器学习实战

Posts & Telecom Press, Siamak Amirghodsi, Meenakshi Rajendran, Broderick Hall, Shuen Mei
写给系统管理员的Python脚本编程指南

写给系统管理员的Python脚本编程指南

Posts & Telecom Press, Ganesh Sanjiv Naik
Kubernetes编程

Kubernetes编程

Michael Hausenblas, Stefan Schimanski

Publisher Resources

ISBN: 9787115601421