Skip to Content
For Enterprise
For Government
For Higher Ed
For Individuals
For Marketing
For Enterprise
For Government
For Higher Ed
For Individuals
For Marketing
Explore Skills
Cloud Computing
Microsoft Azure
Amazon Web Services (AWS)
Google Cloud
Cloud Migration
Cloud Deployment
Cloud Platforms
Data Engineering
Data Warehouse
SQL
Apache Spark
Microsoft SQL Server
MySQL
Kafka
Data Lake
Streaming & Messaging
NoSQL Databases
Relational Databases
Data Science
Pandas
R
MATLAB
SAS
D3
Power BI
Tableau
Statistics
Exploratory Data Analysis
Data Visualization
AI & ML
Generative AI
Machine Learning
Artificial Intelligence (AI)
Deep Learning
Reinforcement Learning
Natural Language Processing
TensorFlow
Scikit-Learn
Hyperparameter Tuning
MLOps
Programming Languages
Java
JavaScript
Spring
Python
Go
C#
C++
C
Swift
Rust
Functional Programming
Software Architecture
Object-Oriented
Distributed Systems
Domain-Driven Design
Architectural Patterns
IT/Ops
Kubernetes
Docker
GitHub
Terraform
Continuous Delivery
Continuous Integration
Database Administration
Computer Networking
Operating Systems
IT Certifications
Security
Network Security
Application Security
Incident Response
Zero Trust Model
Disaster Recovery
Penetration Testing / Ethical Hacking
Governance
Malware
Security Architecture
Security Engineering
Security Certifications
Design
Web Design
Graphic Design
Interaction Design
Film & Video
User Experience (UX)
Design Process
Design Tools
Business
Agile
Project Management
Product Management
Marketing
Human Resources
Finance
Team Management
Business Strategy
Digital Transformation
Organizational Leadership
Soft Skills
Professional Communication
Emotional Intelligence
Presentation Skills
Innovation
Critical Thinking
Public Speaking
Collaboration
Personal Productivity
Confidence / Motivation
Features
All features
Verifiable skills
AI Academy
Courses
Certifications
Interactive learning
Live events
Superstreams
Answers
Insights reporting
Radar Blog
Buy Courses
Plans
Sign In
Try Now
O'Reilly Platform
book
Presto实战
by
Matt Fuller
,
Manfred Moser
,
Martin Traverso
March 2021
Intermediate to advanced
265 pages
6h 50m
Chinese
Posts & Telecom Press
Content preview from
Presto实战
106
|
第
7
章
不同主题内的
Kafka
消息可能使用不同的格式,
Kafka
连接器包括了最常见格式的解码器,
如
Raw
、
JSON
、
CSV
和
A
vro
等。
有关配置属性、映射和其他内部列的详细信息可在
Presto
文档中找到,参见
1.4.3
节。
将
Presto
与
Kafka
一起使用
,既可以为
Kafka
的数据流开启新的分析与洞察能力,也定义了
Presto
另一个有价值的用途。另一个
Presto
支持的类似用途的流处理系统是
AmazonKinesis
1
。
7.5
文档存储连接器示例
:
Elasticsearch
Presto
包含一些知名文档存储系统的连接器,如
Elasticsearch
或
MongoDB
。这些系统支持
存储和检索
JSON
文档形式的信息
。
Elasticsearch
更适合于索引和搜索文档,而
MongoDB
则是一个通用的文档存储。
7.5.1
概述
Presto
连接器允许用户使用
SQL
访问这些系统并查询其中的数据,即使这些系统没有原生
SQL
访问。
Elasticsearch
集群
经常用于存储日志数据或其他事件流,以便长期存储,甚至永久存储。
这些数据集都是系统在运行中和各种场景下产生的日志数据,往往体量非常大,这些日志
可以帮我们更好地了解系统。
Elasticsearch
和
Presto
是一个强大且性能优异的组合
,因为这两个系统都可以横向扩展。
Presto
通过将一个查询分解并在集群中的许多工作节点上运行来进行扩展。
Elasticsearch
通常在自己的集群上运行
,也可以横向扩展。它可以跨多个节点对索引分片,
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.
Start your free trial
You might also like
大数据项目管理:从规划到实现
Ted Malaska, Jonathan Seidman
数据库系统内幕
Alex Petrov
云原生:运用容器、函数计算和数据构建下一代应用
Boris Scholl, Trent Swanson, Peter Jausovec
Google系统架构解密: 构建安全可靠的系统
Heather Adkins, Betsy Beyer, Paul Blankinship, Piotr Lewandowski, Ana Oprea, Adam Stubblefield
Publisher Resources
ISBN: 9787115560056