Skip to Content
Kafka权威指南
book

Kafka权威指南

by Neha Narkhede, Gwen Shapira, Todd Palino
January 2018
Beginner to intermediate
234 pages
7h 8m
Chinese
Posts & Telecom Press
Content preview from Kafka权威指南
12
1
而且解析
XML
文件非常耗费计算资源。要想更改所创建的活动类型,需要在前端应用和
离线处理程序之间做大量的协调工作。即使是这样,在更改数据结构时,仍然经常出现系
统崩溃现象。而且批处理时间以小时计算,无法用它完成实时的任务。
监控和用户活动跟踪无法使用同一个后端服务。监控服务太过笨重,数据格式不适用于活
动跟踪,而且无法在活动跟踪中使用轮询拉取模型。另一方面,把跟踪服务用在度量指标
上也过于脆弱,批处理模型不适用于实时的监控和告警。不过,好在数据间存在很多共
性,信息(比如特定类型的用户活动对应用程序性能的影响)之间的关联度还是很高的。
特定类型用户活动数量的下降说明相关应用程序存在问题,不过批处理的长时间延迟意味
着无法对这类问题作出及时的反馈。
最开始,我们调研了一些现成的开源解决方案,希望能够找到一个系统,可以实时访问
数据,并通过横向扩展来处理大量的消息。我们使用
ActiveMQ
创建了一个原型系统,但
它当时还无法满足横向扩展的需求。
LinkedIn
不得不使用这种脆弱的解决方案,虽然
ActiveMQ
有很多缺陷会导致
broker
暂停服务。客户端的连接因此被阻塞,处理用户请求
的能力也受到影响。于是我们最后决定构建自己的基础设施。
1.5.2
 
Kafka
的诞生
LinkedIn
的开发团队由
Jay Kreps
领导。
Jay Kreps
LinkedIn
的首席工程师,之前负责分
布式键值存储系统
Voldemort
的开发。初建团队成员还包括
Neha Narkhede
,不久之后,
Jun Rao
也加入了进来。他们一起着手创建一个消息系统,可以同时满足上述的两种需求, ...
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.

Read now

Unlock full access

More than 5,000 organizations count on O’Reilly

AirBnbBlueOriginElectronic ArtsHomeDepotNasdaqRakutenTata Consultancy Services

QuotationMarkO’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.
Julian F.
Head of Cybersecurity
QuotationMarkI wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.
Addison B.
Field Engineer
QuotationMarkI’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.
Amir M.
Data Platform Tech Lead
QuotationMarkI'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.
Mark W.
Embedded Software Engineer

You might also like

精通機器學習

精通機器學習

Aurélien Géron
精通特征工程

精通特征工程

Alice Zheng, Amanda Casari
高效能PYTHON程式設計

高效能PYTHON程式設計

Micha Gorelick, Ian Ozsvald

Publisher Resources

ISBN: 9787115473271