Skip to Content
数据压缩入门
book

数据压缩入门

by Colt McAnlis, Aleks Haecky
April 2020
Intermediate to advanced
210 pages
4h 47m
Chinese
Posts & Telecom Press
Content preview from 数据压缩入门
97
第 8 章
上下文数据转换
在开始本章内容前,我们先花一些时间回顾一下前面的内容。
统计编码算法工作时会为每个符号分配一个长度可变的码字,压缩主要来自于为越频繁
出现的符号分配越短的码字。而字典转换的分词过程会识别出数据集中最长且最频繁出
现的那些符号。实际上,只有分词过程找出了那些最适合的符号,编码的效率才能提高。
从技术上来说,我们完全可以通过分词过程识别出那些最适合编码的符号,然后再将所
得结果交给统计编码算法处理以得到压缩的效果。然而,
LZ
算法的真正威力体现在我们
没有那样去做,而是用熵值较低的记号二元组来表示匹配的信息,然后再去压缩这些记
号二元组。
除了字典变换之外,还有一整套其他的变换都是按照同样的原理工作的:给定一组相邻的
符号集,对它们进行某种方式的变换使其更容易压缩。我们通常称这样的变换为“上下文
变换”(
contextual transform
),因为在思考数据的理想编码方式时,这些方法考虑到了邻近
符号的影响。
这些变换的目标是一致的,即通过对这些信息进行某种方式的变换,使统计编码算法对其
进行压缩时更高效。
变换数据的方法有很多种,但其中有
3
种对现代的数据压缩来说最为重要,即
行程编码
(
run-length encoding
,
RLE
)、
增量编码
(
delta coding
)和
伯罗斯
–
惠勒变换
(
Burrows-Wheeler
transform
,
BWT
)。
下面分别介绍这
3
种方法。
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.

Read now

Unlock full access

More than 5,000 organizations count on O’Reilly

AirBnbBlueOriginElectronic ArtsHomeDepotNasdaqRakutenTata Consultancy Services

QuotationMarkO’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.
Julian F.
Head of Cybersecurity
QuotationMarkI wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.
Addison B.
Field Engineer
QuotationMarkI’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.
Amir M.
Data Platform Tech Lead
QuotationMarkI'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.
Mark W.
Embedded Software Engineer

You might also like

人工智能技术与大数据

人工智能技术与大数据

Posts & Telecom Press, Anand Deshpande, Manish Kumar
解密金融数据

解密金融数据

Justin Pauley

Publisher Resources

ISBN: 9787115534170