25 Information Theory and Coding

Richard E. Blahut

Coding for Noiseless Channels

Capacity of Discrete Noiseless Channels
State Diagrams and Trellises

Source Compaction Codes

Source Models
The Entropy Function
Source Encoding
Fixed-Length Block Codes
Variable-Length Block Codes
Variable-Length Tree Codes
Universal Codes

Coding for Discrete Noisy Channels

Mutual Information
Channel Capacity
Error-Control Codes
Block Codes
Convolutional Codes

Continuous Channels and Sources

The Sampling Theorem
Differential Entropy
Entropy Power
Capacity of a Continuous Channel
The Additive Gaussian Noise Channel
Waveform Channels
Bit Energy and Bit Error Rate
Signaling Without Bandwidth Constraints
Signaling With a Bandwidth Constraint

Decision Theory ...

Get Reference Data for Engineers, 9th Edition now with the O’Reilly learning platform.

O’Reilly members experience live online training, plus books, videos, and digital content from nearly 200 publishers.

Start your free trial