Skip to Content
数据工程之道:设计和构建健壮的数据系统
book

数据工程之道:设计和构建健壮的数据系统

by Joe Reis, Matt Housley
February 2024
Intermediate to advanced
370 pages
7h
Chinese
China Machine Press
Content preview from 数据工程之道:设计和构建健壮的数据系统
存储
|
185
磁盘上的格式化很相似,但存储通常是虚拟化的。(我们将在后面介绍云虚拟化块存储)
RAID
如前所述,
RAID
独立磁盘冗余阵列
的意思。
RAID
同时控制多个磁盘,以提高数据的
耐久性、增强性能,并结合多个驱动器的容量。一个阵列在操作系统中可以显示为一个
单一的块设备。许多编码和奇偶校验方案是可用的,这取决于增强的有效带宽和更高的
容错性(对许多磁盘故障的容忍度)之间的理想平衡。
存储区域网络
存储区域网络
系统通过网络提供虚拟化的块存储设备,通常来自一个存储池。
SAN
的抽
象可以允许细粒度的存储扩展,并提高性能、可用性和耐久性。如果你在处理本地存储系
统,你可能会遇到
SAN
系统。你还可能会遇到云版本的
SAN
,如下面我们将讨论的部分。
云虚拟化块存储
云虚拟化块存储
解决方案与
SAN
类似,但云使工程师无须处理
SAN
集群和网络细节。
我们将把亚马逊弹性块存储(
Elastic Block Store
EBS
)作为一个标准例子,其他公有
云也有类似的产品。
EBS
是亚马逊
EC2
虚拟机的默认存储。其他云供应商也将虚拟化对
象存储作为其虚拟机产品的一个关键组成部分。
EBS
提供了几个级别的服务,具有不同的性能特征。一般来说,
EBS
的性能指标是以
IOPS
和吞吐量(传输速度)给出的。性能较高的
EBS
存储层由固态硬盘支持,而由磁
盘支持的存储层提供较低的
IOPS
,但每
GB
的成本较低。
EBS
卷与实例主机服务器分开存储数据,但位于同一区域,以支持高性能和低延迟(如
6-5
所示)。这使得
EBS
卷在
EC2
实例关闭时、主机服务器故障时 ...
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.

Read now

Unlock full access

More than 5,000 organizations count on O’Reilly

AirBnbBlueOriginElectronic ArtsHomeDepotNasdaqRakutenTata Consultancy Services

QuotationMarkO’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.
Julian F.
Head of Cybersecurity
QuotationMarkI wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.
Addison B.
Field Engineer
QuotationMarkI’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.
Amir M.
Data Platform Tech Lead
QuotationMarkI'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.
Mark W.
Embedded Software Engineer

You might also like

设计数据密集型应用程序

设计数据密集型应用程序

Martin Kleppmann
Understanding DeFi

Understanding DeFi

Alexandra Damsker
INSPIRED

INSPIRED

Marty Cagan

Publisher Resources

ISBN: 9787111745273