Information Theory and Coding

Chapter Outline

Learning Objectives

  • Definition of Information and Measure of Information Content
  • Average Information Transmitted or Entropy
  • Information Rate
  • Shannon-Fano Theorem of Coding
  • Channel Capacity
  • Encoding Techniques
  • Error Coding

12.1 Introduction

Communication means exchange of information. Information theory aims to estimate the information content of any signal. The importance of any information depends on its news value. In our day-to-day life an event that occurs ...

Get Analog and Digital Communications now with O’Reilly online learning.

O’Reilly members experience live online training, plus books, videos, and digital content from 200+ publishers.