Skip to Content
For Enterprise
For Government
For Higher Ed
For Individuals
For Marketing
For Enterprise
For Government
For Higher Ed
For Individuals
For Marketing
Explore Skills
Cloud Computing
Microsoft Azure
Amazon Web Services (AWS)
Google Cloud
Cloud Migration
Cloud Deployment
Cloud Platforms
Data Engineering
Data Warehouse
SQL
Apache Spark
Microsoft SQL Server
MySQL
Kafka
Data Lake
Streaming & Messaging
NoSQL Databases
Relational Databases
Data Science
Pandas
R
MATLAB
SAS
D3
Power BI
Tableau
Statistics
Exploratory Data Analysis
Data Visualization
AI & ML
Generative AI
Machine Learning
Artificial Intelligence (AI)
Deep Learning
Reinforcement Learning
Natural Language Processing
TensorFlow
Scikit-Learn
Hyperparameter Tuning
MLOps
Programming Languages
Java
JavaScript
Spring
Python
Go
C#
C++
C
Swift
Rust
Functional Programming
Software Architecture
Object-Oriented
Distributed Systems
Domain-Driven Design
Architectural Patterns
IT/Ops
Kubernetes
Docker
GitHub
Terraform
Continuous Delivery
Continuous Integration
Database Administration
Computer Networking
Operating Systems
IT Certifications
Security
Network Security
Application Security
Incident Response
Zero Trust Model
Disaster Recovery
Penetration Testing / Ethical Hacking
Governance
Malware
Security Architecture
Security Engineering
Security Certifications
Design
Web Design
Graphic Design
Interaction Design
Film & Video
User Experience (UX)
Design Process
Design Tools
Business
Agile
Project Management
Product Management
Marketing
Human Resources
Finance
Team Management
Business Strategy
Digital Transformation
Organizational Leadership
Soft Skills
Professional Communication
Emotional Intelligence
Presentation Skills
Innovation
Critical Thinking
Public Speaking
Collaboration
Personal Productivity
Confidence / Motivation
Features
All features
Verifiable skills
AI Academy
Courses
Certifications
Interactive learning
Live events
Superstreams
Answers
Insights reporting
Radar Blog
Buy Courses
Plans
Sign In
Try Now
O'Reilly Platform
book
Presto实战
by
Matt Fuller
,
Manfred Moser
,
Martin Traverso
March 2021
Intermediate to advanced
265 pages
6h 50m
Chinese
Posts & Telecom Press
Content preview from
Presto实战
74
|
第
5
章
Presto
项目本身并没有提供一套完整的、使
Presto
集群便于使用的资源和
工具链。使用者通常要创建他们自己的包、配置管理工具、容器镜像、
k8s
operator
或者其他必要的组件
,他们也可能使用类似
Concord
或者
Terraform
这样的工具来创建和管理集群。或者,你也可以选择依赖类似
Starburst
这样
的公司所提供的服务和支持。
5.10
集群规模的考量
部署
Presto
的一个重要方面是集群的规模。长期来看,你甚至可能会运行多个针对不同使
用场景的集群。调整
Presto
集群的规模是一项复杂的任务
,并遵循与其他应用程序一样的
模式和步骤。
1.
基于粗略估计和可用的基础设施决定初始规模。
2.
确保集群的工具和基础设施支持集群伸缩。
3.
启动集群并逐步增加使用量。
4.
监控使用率和性能。
5.
根据观察到的结果调整集群的规模和配置。
由监控、调整和继续使用构成的反馈闭环可以让你更好地了解
Presto
部署的行为。
许多因素会影响集群性能,不同
Presto
部署会受这些因素的不同组合的影响。
•
每个节点的资源,如
CPU
和内存。
•
集群内部以及集群到数据源和存储的网络性能。
•
连接的数据源的数量和特性。
•
在数据源上执行的查询及其范围、复杂度、数量和结果数据量。
•
数据源存储的读写性能。
•
活跃用户及其使用模式。
当部署好初始集群后,要确保充分利用
Presto
WebUI
进行监控。第
12
章提供了更多信息。
5.11
小结
如你所见,安装和运行
Presto
集群只需少量的配置文件和属性即可。基于实际的基础设施 ...
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.
Start your free trial
You might also like
大数据项目管理:从规划到实现
Ted Malaska, Jonathan Seidman
数据库系统内幕
Alex Petrov
云原生:运用容器、函数计算和数据构建下一代应用
Boris Scholl, Trent Swanson, Peter Jausovec
Google系统架构解密: 构建安全可靠的系统
Heather Adkins, Betsy Beyer, Paul Blankinship, Piotr Lewandowski, Ana Oprea, Adam Stubblefield
Publisher Resources
ISBN: 9787115560056