Skip to Content
Kafka权威指南
book

Kafka权威指南

by Neha Narkhede, Gwen Shapira, Todd Palino
January 2018
Beginner to intermediate
234 pages
7h 8m
Chinese
Posts & Telecom Press
Content preview from Kafka权威指南
初识
Kafka
9
息流,并保证整个群组对每个给定的消息只处理一次。
1.3.3
 基于磁盘的数据存储
Kafka
不仅支持多个消费者,还允许消费者非实时地读取消息,这要归功于
Kafka
的数据
保留特性。消息被提交到磁盘,根据设置的保留规则进行保存。每个主题可以设置单独的
保留规则,以便满足不同消费者的需求,各个主题可以保留不同数量的消息。消费者可能
会因为处理速度慢或突发的流量高峰导致无法及时读取消息,而持久化数据可以保证数据
不会丢失。消费者可以在进行应用程序维护时离线一小段时间,而无需担心消息丢失或堵
塞在生产者端。消费者可以被关闭,但消息会继续保留在
Kafka
里。消费者可以从上次中
断的地方继续处理消息。
1.3.4
 伸缩性
为了能够轻松处理大量数据,
Kafka
从一开始就被设计成一个具有灵活伸缩性的系统。用
户在开发阶段可以先使用单个
broker
,再扩展到包含
3
broker
的小型开发集群,然后随
着数据量不断增长,部署到生产环境的集群可能包含上百个
broker
。对在线集群进行扩展
丝毫不影响整体系统的可用性。也就是说,一个包含多个
broker
的集群,即使个别
broker
失效,仍然可以持续地为客户提供服务。要提高集群的容错能力,需要配置较高的复制系
数。第
6
章将讨论关于复制的更多细节。
1.3.5
 高性能
上面提到的所有特性,让
Kafka
成为了一个高性能的发布与订阅消息系统。通过横向扩展
生产者、消费者和
broker
Kafka
可以轻松处理巨大的消息流。在处理大量数据的同时,
它还能保证亚秒级的消息延迟。 ...
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.

Read now

Unlock full access

More than 5,000 organizations count on O’Reilly

AirBnbBlueOriginElectronic ArtsHomeDepotNasdaqRakutenTata Consultancy Services

QuotationMarkO’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.
Julian F.
Head of Cybersecurity
QuotationMarkI wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.
Addison B.
Field Engineer
QuotationMarkI’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.
Amir M.
Data Platform Tech Lead
QuotationMarkI'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.
Mark W.
Embedded Software Engineer

You might also like

精通機器學習

精通機器學習

Aurélien Géron
精通特征工程

精通特征工程

Alice Zheng, Amanda Casari
高效能PYTHON程式設計

高效能PYTHON程式設計

Micha Gorelick, Ian Ozsvald

Publisher Resources

ISBN: 9787115473271