O'Reilly logo

The Cable and Telecommunications Professionals' Reference, 3rd Edition by Goff Hill

Stay ahead with the world's most comprehensive technology and business learning platform.

With Safari, you learn the way you learn best. Get unlimited access to videos, live online training, learning paths, books, tutorials, and more.

Start Free Trial

No credit card required

24  Information Theory

William J. Fitzgerald

Introduction

In this chapter, the ideas associated with information and entropy are considered and related to probability defined in terms of incomplete knowledge. Mutual and self information are introduced, and these concepts are applied to various models for communications channels.

The concepts of information and related quantity entropy date back to the early days of thermodynamics. The concept of entropy arose in considerations connected with the theory of heat, and its relationship to information was not at first realized. However, in retrospect it is not surprising that the analytical treatment of information should have its origin in this area of physical science, for the subject of thermodynamics ...

With Safari, you learn the way you learn best. Get unlimited access to videos, live online training, learning paths, books, interactive tutorials, and more.

Start Free Trial

No credit card required