Skip to Content
For Enterprise
For Government
For Higher Ed
For Individuals
For Marketing
For Enterprise
For Government
For Higher Ed
For Individuals
For Marketing
Explore Skills
Cloud Computing
Microsoft Azure
Amazon Web Services (AWS)
Google Cloud
Cloud Migration
Cloud Deployment
Cloud Platforms
Data Engineering
Data Warehouse
SQL
Apache Spark
Microsoft SQL Server
MySQL
Kafka
Data Lake
Streaming & Messaging
NoSQL Databases
Relational Databases
Data Science
Pandas
R
MATLAB
SAS
D3
Power BI
Tableau
Statistics
Exploratory Data Analysis
Data Visualization
AI & ML
Generative AI
Machine Learning
Artificial Intelligence (AI)
Deep Learning
Reinforcement Learning
Natural Language Processing
TensorFlow
Scikit-Learn
Hyperparameter Tuning
MLOps
Programming Languages
Java
JavaScript
Spring
Python
Go
C#
C++
C
Swift
Rust
Functional Programming
Software Architecture
Object-Oriented
Distributed Systems
Domain-Driven Design
Architectural Patterns
IT/Ops
Kubernetes
Docker
GitHub
Terraform
Continuous Delivery
Continuous Integration
Database Administration
Computer Networking
Operating Systems
IT Certifications
Security
Network Security
Application Security
Incident Response
Zero Trust Model
Disaster Recovery
Penetration Testing / Ethical Hacking
Governance
Malware
Security Architecture
Security Engineering
Security Certifications
Design
Web Design
Graphic Design
Interaction Design
Film & Video
User Experience (UX)
Design Process
Design Tools
Business
Agile
Project Management
Product Management
Marketing
Human Resources
Finance
Team Management
Business Strategy
Digital Transformation
Organizational Leadership
Soft Skills
Professional Communication
Emotional Intelligence
Presentation Skills
Innovation
Critical Thinking
Public Speaking
Collaboration
Personal Productivity
Confidence / Motivation
Features
All features
Verifiable skills
AI Academy
Courses
Certifications
Interactive learning
Live events
Superstreams
Answers
Insights reporting
Radar Blog
Buy Courses
Plans
Sign In
Try Now
O'Reilly Platform
book
Presto实战
by
Matt Fuller
,
Manfred Moser
,
Martin Traverso
March 2021
Intermediate to advanced
265 pages
6h 50m
Chinese
Posts & Telecom Press
Content preview from
Presto实战
39
第
4
章
Presto
的架构
前面几章介绍了
Presto
及其初始安装和使用,本章来讨论
Presto
的架构。我们将深入介绍
Presto
的查询执行模型、查询计划以及基于代价的查询优化算法等相关概念。
首先本章从宏观上介绍
Presto
的架构组件
。大致了解
Presto
的工作方式非常重要,特别是
要自己安装和维护一个
Presto
集群(参见第
5
章)时。
然后本章会在讨论
Presto
的执
行模型时更深入地介绍这些组件。这些知识是你诊断和调优
慢查询(参见第
8
章)或向
Presto
开源项目贡献代码的基础。
4.1
集群中的协调器和工作节点
如果按照第
2
章介绍的方法安装并使用
Presto
,它就只会运行在一台机器上,这种部署方
式不具备可扩展性且性能受限。
Presto
是一个分布式
SQL
查询引擎,
类似于
大规模并行处理
(
massivelyparallelprocessing
,
MPP
)数据库
。
Presto
通过在整个集群的服务器上分配处理任务来实现横向扩展,而非通
过提高单台服务器性能来进行纵向扩展。这意味着,你可以通过添加更多的计算节点来获
得更强大的处理能力。
基于这种架构,
Presto
的查询引擎可以在集群内的计算节点上并行处理海量数据上的
SQL
查询。在每个计算节点上,
Presto
都以单个服务端进程的形式运行
。一个
Presto
集群由多
个被配置为相互协作的
Presto
节点所组成。
图
4-1
是一个具有单个协调器和多个工作节点的
Presto
集群的概览
。用户使用客户端程序
40
|
第
4
章
(如使用
JDBC
驱动的工具或
Presto ...
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.
Start your free trial
You might also like
大数据项目管理:从规划到实现
Ted Malaska, Jonathan Seidman
数据库系统内幕
Alex Petrov
云原生:运用容器、函数计算和数据构建下一代应用
Boris Scholl, Trent Swanson, Peter Jausovec
Google系统架构解密: 构建安全可靠的系统
Heather Adkins, Betsy Beyer, Paul Blankinship, Piotr Lewandowski, Ana Oprea, Adam Stubblefield
Publisher Resources
ISBN: 9787115560056