Skip to Content
Kafka权威指南
book

Kafka权威指南

by Neha Narkhede, Gwen Shapira, Todd Palino
January 2018
Beginner to intermediate
234 pages
7h 8m
Chinese
Posts & Telecom Press
Content preview from Kafka权威指南
监控
Kafka
183
10.5
 端到端监控
我们推荐使用的另一种外部监控系统是端到端的监控系统,它为
Kafka
集群的健康状态提
供了一种客户端视图。消费者和生产者客户端有一些度量指标能够说明集群可能出现了
问题,但这里有猜想的成分,因为延时的增加有可能是由客户端、网络或
Kafka
本身引起
的。另外,用户原本的工作可能只是管理
Kafka
集群,但现在也需要监控客户端。现在只
需要回答以下两个简单的问题。
可以向
Kafka
集群生成消息吗?
可以从
Kafka
集群读取消息吗?
理想情况下,用户可能会希望每一个主题都允许这些操作,但要为此向每一个主题注入人
为的流量是不合理的。所以,可以考虑是否每个
broker
都允许这些操作,而这正是
Kafka
Monitor
要做的事情。该工具由
LinkedIn
Kafka
团队开发并开源,它持续地向一个横跨
集群所有
broker
的主题生成消息,并读取这些消息。它对每个
broker
的生产请求和读取请
求的可用性进行度量,包括从生产到读取的整体延时。这种类型的监控对于验证
Kafka
群的运行状态来说是非常有价值的,因为
Kafka broker
本身无法告知客户端是否能够正常
使用集群。
10.6
 总结
监控是运行
Kafka
的一个重要组成部分,这也是为什么有那么多的团队在这上面花费了那
么多时间。很多组织使用
Kafka
处理千万亿字节级别的数据流。确保数据的持续性和不丢
失消息是一个关键性的业务需求。作为
Kafka
集群的运维人员,我们的目标是成为最了解
集群状态的人。同时,要协助用户监控他们的应用程序。 ...
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.

Read now

Unlock full access

More than 5,000 organizations count on O’Reilly

AirBnbBlueOriginElectronic ArtsHomeDepotNasdaqRakutenTata Consultancy Services

QuotationMarkO’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.
Julian F.
Head of Cybersecurity
QuotationMarkI wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.
Addison B.
Field Engineer
QuotationMarkI’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.
Amir M.
Data Platform Tech Lead
QuotationMarkI'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.
Mark W.
Embedded Software Engineer

You might also like

精通機器學習

精通機器學習

Aurélien Géron
精通特征工程

精通特征工程

Alice Zheng, Amanda Casari
高效能PYTHON程式設計

高效能PYTHON程式設計

Micha Gorelick, Ian Ozsvald

Publisher Resources

ISBN: 9787115473271