Skip to Content
Trino 权威指南:原书第2版
book

Trino 权威指南:原书第2版

by Matt Fuller, Manfred Moser, Martin Traverso
July 2023
Intermediate to advanced
278 pages
5h 40m
Chinese
China Machine Press
Content preview from Trino 权威指南:原书第2版
高级连接器示例
|
119
)
AS
SELECT *
FROM trafficstream.web.pages;
一旦有了这个表,你就可以定期运行
INSERT
查询,向其中插入更多的数据:
INSERT INTO hdfs.web.pages
SELECT *
FROM trafficstream.web.pages;
为了避免重复复制,你可以跟踪一些
Kafka
中的由连接器暴露的内部列,具体来说,可
以使用
_partition_id
_partition_offset
_segment_start
_segmen_end
_segment_
count
列。定期运行查询的具体设置取决于
Kafka
中关于删除消息的配置以及运行查询
的工具,例如
Apache Airflow
,参见
11.3
节。
Kafka
主题以表的形式暴露,其映射和包含的消息可以用一个
JSON
文件来定义,每个
主题的映射可以在
etc/kafka/schema.tablename.json
中定义。具体到前面的例子,可以在
etc/kafka/web.pages.json
中定义映射。
不同主题内的
Kafka
消息可能使用不同的格式,
Kafka
连接器包括了最常见格式的解码
器,如
Raw
JSON
CSV
Avro
https://avro.apache.org
)等。
有关配置属性、映射和其他内部列的详细信息可在
Trino
文档中找到,参见
1.4.2
节。
Trino
Kafka
一起使用,既可以为
Kafka
的数据流开启新的分析与洞察能力,也定义了
Trino
另一个有价值的用途。另一个 ...
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.

Read now

Unlock full access

More than 5,000 organizations count on O’Reilly

AirBnbBlueOriginElectronic ArtsHomeDepotNasdaqRakutenTata Consultancy Services

QuotationMarkO’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.
Julian F.
Head of Cybersecurity
QuotationMarkI wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.
Addison B.
Field Engineer
QuotationMarkI’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.
Amir M.
Data Platform Tech Lead
QuotationMarkI'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.
Mark W.
Embedded Software Engineer

You might also like

What Successful Brick-and-Mortar Retailers Get Right

What Successful Brick-and-Mortar Retailers Get Right

Rob Angell
Three Essentials for Agentic AI Security

Three Essentials for Agentic AI Security

Paolo Dal Cin, Daniel Kendzior, Yusof Seedat, Renato Marinho
What Successful Project Managers Do

What Successful Project Managers Do

W. Scott Cameron, Jeffrey S. Russell, Edward J. Hoffman, Alexander Laufer

Publisher Resources

ISBN: 9787111731603