Chapter 5

Basic Information Theory

Chapter Objectives

After reading this chapter and completing the review questions, you will be able to do the following:

  • Understand basic information theory

  • Calculate information entropy

  • Recognize information diversity

Information theory is central to computer science, and it is important in quantum computing. The topic of information theory was introduced by Claude Shannon in his 1948 paper, “A Mathematical Theory of Communication.” Shannon was primarily concerned with signal processing, data compression, and related topics. However, the field of information theory has grown since then. The focus of information theory is quantifying and communicating information. The field of information theory is closely ...

Get Quantum Computing Fundamentals now with the O’Reilly learning platform.

O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.