Skip to Content
For Enterprise
For Government
For Higher Ed
For Individuals
For Marketing
For Enterprise
For Government
For Higher Ed
For Individuals
For Marketing
Explore Skills
Cloud Computing
Microsoft Azure
Amazon Web Services (AWS)
Google Cloud
Cloud Migration
Cloud Deployment
Cloud Platforms
Data Engineering
Data Warehouse
SQL
Apache Spark
Microsoft SQL Server
MySQL
Kafka
Data Lake
Streaming & Messaging
NoSQL Databases
Relational Databases
Data Science
Pandas
R
MATLAB
SAS
D3
Power BI
Tableau
Statistics
Exploratory Data Analysis
Data Visualization
AI & ML
Generative AI
Machine Learning
Artificial Intelligence (AI)
Deep Learning
Reinforcement Learning
Natural Language Processing
TensorFlow
Scikit-Learn
Hyperparameter Tuning
MLOps
Programming Languages
Java
JavaScript
Spring
Python
Go
C#
C++
C
Swift
Rust
Functional Programming
Software Architecture
Object-Oriented
Distributed Systems
Domain-Driven Design
Architectural Patterns
IT/Ops
Kubernetes
Docker
GitHub
Terraform
Continuous Delivery
Continuous Integration
Database Administration
Computer Networking
Operating Systems
IT Certifications
Security
Network Security
Application Security
Incident Response
Zero Trust Model
Disaster Recovery
Penetration Testing / Ethical Hacking
Governance
Malware
Security Architecture
Security Engineering
Security Certifications
Design
Web Design
Graphic Design
Interaction Design
Film & Video
User Experience (UX)
Design Process
Design Tools
Business
Agile
Project Management
Product Management
Marketing
Human Resources
Finance
Team Management
Business Strategy
Digital Transformation
Organizational Leadership
Soft Skills
Professional Communication
Emotional Intelligence
Presentation Skills
Innovation
Critical Thinking
Public Speaking
Collaboration
Personal Productivity
Confidence / Motivation
Features
All features
Verifiable skills
AI Academy
Courses
Certifications
Interactive learning
Live events
Superstreams
Answers
Insights reporting
Radar Blog
Buy Courses
Plans
Sign In
Try Now
O'Reilly Platform
book
数据压缩入门
by
Colt McAnlis
,
Aleks Haecky
April 2020
Intermediate to advanced
210 pages
4h 47m
Chinese
Posts & Telecom Press
Content preview from
数据压缩入门
自适应统计编码
|
73
6.2
自适应
VLC
编码
下面来看看自适应算法中最简单的一种,了解其基本的工作原理。
一般来说,统计压缩有
3
个步骤
5
:
(1)
遍历数据流并计算各个符号的出现概率;
(2)
根据概率为符号生成
VLC
;
(3)
再次遍历数据流并输出对应的码字。
从上面可以看出,压缩时需要遍历(或者说扫描)数据流两次,并且整个数据集只有一套
VLC
表。这里的问题是,
VLC
表是静态的。
而在
自适应
的压缩算法中,这
3
个步骤简化为仅遍历一次数据集,但是过程要更复杂。关
键是符号码字对应表并非必须一成不变,相反,可以根据读到的符号更新它。
自适应统计编码的关键在于其符号码字对应表并非一成不变,相反,可以根
据读到的符号动态地生成
VLC
。这一过程的动态性质,让我们可以根据需要
对
VLC
表进行修改,比如对其重置。
6.2.1
动态创建
VLC
表
动态创建
VLC
表的原理如下。
在编码器处理数据流时,每读取一个符号,编码器都会问:
•
这个符号之前出现过吗?
–
如果出现过,那么输出当前分配的码字,并更新其出现的概率。
–
如果没有,则进行一些特殊处理(稍后会讲到这个部分)。
请记住上面的内容。假定你正在处理某个数据流,已经知道了其中的符号及相应的概率期
望。目前已有的
VLC
表如下表所示。
符号
概率
码字
A
0.5
0
B
0.4
10
C
0.1
11
注
5
:
当和那些非常聪明的人谈论数据压缩时,他们通常会认为统计编码只有两个步骤:建模和预测。
John
Brooks
,看到这里,你很高兴吧?
74
|
第
6
章
接下来,需要从输入流中读取下一个符号,这个符号恰好是 ...
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.
Start your free trial
You might also like
解密金融数据
Justin Pauley
人工智能技术与大数据
Posts & Telecom Press, Anand Deshpande, Manish Kumar
神经网络算法与Java编程
Posts & Telecom Press, Fabio M. Soares, Alan M. F. Souza
Go程序设计语言
艾伦A. A.多诺万, 布莱恩W. 柯尼汉
Publisher Resources
ISBN: 9787115534170