Skip to Content
Kafka权威指南
book

Kafka权威指南

by Neha Narkhede, Gwen Shapira, Todd Palino
January 2018
Beginner to intermediate
234 pages
7h 8m
Chinese
Posts & Telecom Press
Content preview from Kafka权威指南
初识
Kafka
11
的数据分析,比如年度增长走势预测。日志消息也可以被发布到
Kafka
主题上,然后被路
由到专门的日志搜索系统(比如
Elasticsearch
)或安全分析应用程序。更改目标系统(比
如日志存储系统)不会影响到前端应用或聚合方法,这是
Kafka
的另一个优点。
4.
提交日志
Kafka
的基本概念来源于提交日志,所以使用
Kafka
作为提交日志是件顺理成章的事。我
们可以把数据库的更新发布到
Kafka
上,应用程序通过监控事件流来接收数据库的实时更
新。这种变更日志流也可以用于把数据库的更新复制到远程系统上,或者合并多个应用程
序的更新到一个单独的数据库视图上。数据持久化为变更日志提供了缓冲区,也就是说,
如果消费者应用程序发生故障,可以通过重放这些日志来恢复系统状态。另外,紧凑型日
志主题只为每个键保留一个变更数据,所以可以长时间使用,不需要担心消息过期问题。
5.
流处理
流处理是又一个能提供多种类型应用程序的领域。可以说,它们提供的功能与
Hadoop
map
reduce
有点类似,只不过它们操作的是实时数据流,而
Hadoop
则处理更长时间
片段的数据,可能是几个小时或者几天,
Hadoop
会对这些数据进行批处理。通过使用流
式处理框架,用户可以编写小型应用程序来操作
Kafka
消息,比如计算度量指标,为其他
应用程序有效地处理消息分区,或者对来自多个数据源的消息进行转换。第
11
章将通过
其他案例介绍流处理。
1.5
 起源故事
Kafka
是为了解决
LinkedIn
数据管道问题应运而生的。它的设计目的是提供一个高性能的 ...
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.

Read now

Unlock full access

More than 5,000 organizations count on O’Reilly

AirBnbBlueOriginElectronic ArtsHomeDepotNasdaqRakutenTata Consultancy Services

QuotationMarkO’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.
Julian F.
Head of Cybersecurity
QuotationMarkI wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.
Addison B.
Field Engineer
QuotationMarkI’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.
Amir M.
Data Platform Tech Lead
QuotationMarkI'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.
Mark W.
Embedded Software Engineer

You might also like

精通機器學習

精通機器學習

Aurélien Géron
精通特征工程

精通特征工程

Alice Zheng, Amanda Casari
高效能PYTHON程式設計

高效能PYTHON程式設計

Micha Gorelick, Ian Ozsvald

Publisher Resources

ISBN: 9787115473271