Skip to Content
数据工程之道:设计和构建健壮的数据系统
book

数据工程之道:设计和构建健壮的数据系统

by Joe Reis, Matt Housley
February 2024
Intermediate to advanced
370 pages
7h
Chinese
China Machine Press
Content preview from 数据工程之道:设计和构建健壮的数据系统
根据数据生命周期选择技术
|
119
台通常希望其服务接近客户现有云工作负载。出于这个原因,
Snowflake
Databricks
在多云中提供他们的
SaaS
产品。这对数据密集型应用程序来说尤其关键,因为网络延
迟和带宽限制阻碍了性能,而数据出口的成本又很高。
采用多云方法的另一个常见动机是利用几个云中的最佳服务。例如,一家公司可能希望
Google Cloud
上处理其谷歌广告和分析数据,并通过
GKE
部署
Kubernetes
。而该公
司也可能专门为微软的工作负载采用
Azure
。另外,该公司可能喜欢
AWS
,因为它有几
个一流的服务(如
AWS Lambda
,并有很大的心智份额,使其相对容易雇用精通
AWS
的工程师。各种云提供商服务的任何组合都是可能的。鉴于主要云提供商之间的激烈竞
争,预计它们会提供更多的最佳服务,使多云服务更加引人注目。
多云方法也有几个缺点。正如我们刚才提到的,数据出口成本和网络瓶颈是关键。走多
云路线会带来巨大的复杂性。公司现在必须在多个云上管理一系列令人眼花缭乱的服
务。跨云整合和安全是一个相当大的挑战。多云网络可能是非常复杂的。
新诞生的概念“云中云”服务是通过提供跨云的服务、在云之间无缝复制数据和一
个界面管理几个云上的工作负载来促进多云的使用,降低操作的复杂性。举个例子,
Snowflake
账户在单云区运行,但客户可以随时在
GCP
AWS
Azure
中启动其他账户。
Snowflake
在这些不同的云账户之间提供简单的预定的数据复制。在所有这些账户中,
Snowflake
的接口基本相同,消除了在云原生数据服务之间切换的培训负担。 ...
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.

Read now

Unlock full access

More than 5,000 organizations count on O’Reilly

AirBnbBlueOriginElectronic ArtsHomeDepotNasdaqRakutenTata Consultancy Services

QuotationMarkO’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.
Julian F.
Head of Cybersecurity
QuotationMarkI wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.
Addison B.
Field Engineer
QuotationMarkI’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.
Amir M.
Data Platform Tech Lead
QuotationMarkI'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.
Mark W.
Embedded Software Engineer

You might also like

设计数据密集型应用程序

设计数据密集型应用程序

Martin Kleppmann
Understanding DeFi

Understanding DeFi

Alexandra Damsker
INSPIRED

INSPIRED

Marty Cagan

Publisher Resources

ISBN: 9787111745273