Reference Data for Engineers, 9th Edition

25 Information Theory and Coding

Richard E. Blahut

Coding for Noiseless Channels

Capacity of Discrete Noiseless Channels

State Diagrams and Trellises

Source Compaction Codes

Source Models

The Entropy Function

Source Encoding

Fixed-Length Block Codes

Variable-Length Block Codes

Variable-Length Tree Codes

Universal Codes

Coding for Discrete Noisy Channels

Mutual Information

Channel Capacity

Error-Control Codes

Block Codes

Convolutional Codes

Continuous Channels and Sources

The Sampling Theorem

Differential Entropy

Entropy Power

Capacity of a Continuous Channel

The Additive Gaussian Noise Channel

Waveform Channels

Bit Energy and Bit Error Rate

Signaling Without Bandwidth Constraints

Signaling With a Bandwidth Constraint

Decision Theory ...