Skip to Content
构建可扩展分布式系统:方法与实践
book

构建可扩展分布式系统:方法与实践

by Ian Gorton
May 2024
Intermediate
278 pages
5h 24m
Chinese
China Machine Press
Content preview from 构建可扩展分布式系统:方法与实践
流处理系统
|
255
PurchaseTotals
Bolt
发送一系列变化的总购买量到
TopSellers
Bolt
中,在流中创建
最畅销商品的排行榜。
globalGrouping
将所有
PurchaseTotals
实例的输出路由到单个
TopSellers
Bolt
实例。
逻辑
Storm
拓扑如图
15-4
所示。根据部署拓扑的基础集群配置,
Storm
将在一个或多个
可用的
JVM
中的线程上执行指定数量的
Bolt
实例。这使拓扑能够利用部署环境中可用
的计算资源。
15-4Apache Storm 拓扑示例
Apache Storm
是一个功能强大且可扩展的流处理平台。然而,它的
API
相对简单,并将
显式的拓扑定义责任交给了应用程序设计器。在本章的剩余部分,我将转而关注更新的
Apache Flink
,它提供了函数式编程
API
来构建流应用程序。
15.3
案例研究:
Apache Flink
Apache Flink
诞生于
2014
年,基于
European Union Stratosphere
项目(
https://oreil.ly/
JDTQo
)中的原始研究。
Flink
的核心是一个分布式流处理系统,专为高吞吐量和低延迟
而设计。
Flink
提供了一组操作,用于过滤、聚合、映射和连接来自数据源的数据流。与
明确定义的
Apache Storm
拓扑不同,
Flink
程序被编译并自动转换为可以部署在集群计
算环境中的数据流程序。
Flink
提供了许多不同的
API
。我将在以下小节中简要给出
DataStream
(数据流)
API
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.

Read now

Unlock full access

More than 5,000 organizations count on O’Reilly

AirBnbBlueOriginElectronic ArtsHomeDepotNasdaqRakutenTata Consultancy Services

QuotationMarkO’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.
Julian F.
Head of Cybersecurity
QuotationMarkI wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.
Addison B.
Field Engineer
QuotationMarkI’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.
Amir M.
Data Platform Tech Lead
QuotationMarkI'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.
Mark W.
Embedded Software Engineer

You might also like

What Successful Brick-and-Mortar Retailers Get Right

What Successful Brick-and-Mortar Retailers Get Right

Rob Angell
What Successful Project Managers Do

What Successful Project Managers Do

W. Scott Cameron, Jeffrey S. Russell, Edward J. Hoffman, Alexander Laufer
Three Essentials for Agentic AI Security

Three Essentials for Agentic AI Security

Paolo Dal Cin, Daniel Kendzior, Yusof Seedat, Renato Marinho

Publisher Resources

ISBN: 9787111750697