Skip to Content
Presto实战
book

Presto实战

by Matt Fuller, Manfred Moser, Martin Traverso
March 2021
Intermediate to advanced
265 pages
6h 50m
Chinese
Posts & Telecom Press
Content preview from Presto实战
42
4
如果无法接收到一个工作节点的心跳信号,节点发现服务就会触发错误检测器,此后该工
作节点不会再参与新的任务。
为了简化部署并避免运行额外的服务,
Presto
的协调器通常会运行一个内嵌版的节点发现
服务。因为它与
Presto
共享一个
HTTP
服务端,所以使用同一个端口。
因此,工作节点通常将节点发现服务的配置指向协调器的主机名和端口。
4.4
 工作节点
工作节点
Presto
集群中的一个服务端程序
。它负责执行协调器分配的任务并处理数据。
工作节点使用连接器从数据源获取数据,它们相互之间也会交换中间数据。它们将最终的
结果数据发送给协调器,由协调器负责收集来自各个工作节点的结果并发送给客户端。
在安装时,工作节点需要知道集群的节点发现服务所在的主机名或
IP
地址。工作节点会在
启动时将自己注册到节点发现服务上,以便协调器向其分配任务。
工作节点使用
HTTP
与其他工作节点和协调器通信。
4-4
展示了多个工作节点如何从数据源获取数据并合作处理数据
,直到其中一个节点可
以向协调器发送结果。
工作节点
工作节点
工作节点工作节点
4-4:集群中的工作节点相互协作来处理 SQL 语句和数据
4.5
 基于连接器的架构
Presto
存储与计算分离的核心是基于连接器的架构。
连接器
Presto
提供了连接任意数据
源的接口。
每个连接器在底层数据源上提供了一个基于表的抽象。只要数据可以用
Presto
支持
的数据
类型表示成表、列和行,就可以创建连接器并让查询引擎使用这些数据进行查询处理。
Presto
提供了
服务提供者接口
service ...
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.

Read now

Unlock full access

More than 5,000 organizations count on O’Reilly

AirBnbBlueOriginElectronic ArtsHomeDepotNasdaqRakutenTata Consultancy Services

QuotationMarkO’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.
Julian F.
Head of Cybersecurity
QuotationMarkI wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.
Addison B.
Field Engineer
QuotationMarkI’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.
Amir M.
Data Platform Tech Lead
QuotationMarkI'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.
Mark W.
Embedded Software Engineer

You might also like

大数据项目管理:从规划到实现

大数据项目管理:从规划到实现

Ted Malaska, Jonathan Seidman
机器学习流水线实战

机器学习流水线实战

Hannes Hapke, Catherine Nelson

Publisher Resources

ISBN: 9787115560056