7

Information Theory

 

     Emmanuel Abbe, Bixio Rimoldi and Rüdiger Urbanke

7.1 Introduction

7.2 The Communication Problem

7.3 Source Coding for Discrete-Alphabet Sources

7.4 Universal Source Coding

7.5 Rate Distortion Theory

7.6 Channel Coding

Theorem (Shannon's Channel Coding Theorem)

Example (Binary Symmetric Channel)

7.7 Simple Binary Codes

Hamming Codes

Low-Density Parity-Check Codes

Polar Codes

References

Further Reading

7.1 Introduction

 

The field of information theory has its origin in Claude Shannon's 1948 paper, “A Mathematical Theory of Communication.” Shannon's motivation was to study “[The problem] of reproducing at one point either exactly or approximately a message selected at another point.” In this chapter, we will be concerned ...

Get Mobile Communications Handbook, 3rd Edition now with the O’Reilly learning platform.

O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.