Information Theory, Coding and Cryptography

Contents

Foreword

Preface

PART A INFORMATION THEORY AND SOURCE CODING

1. Probability, Random Processes, and Noise

1.1 Introduction

1.2 Fundamentals of Probability

1.2.1 Algebra of Probability

1.2.2 Axioms of Probability

1.2.3 Elementary Theorems on Probability

1.2.4 Conditional Probability

1.2.5 Independent Events

1.2.6 Total Probability

1.3 Random Variables and Its Characteristics

1.3.1 Discrete Random Variable and Probability Mass Function

1.3.2 Cumulative Distribution Function

1.3.3 Distribution Function for Discrete Random Variable

1.3.4 Continuous Random Variable and Probability Density Function

1.4 Statistical Averages

1.5 Frequently Used Probability Distributions

1.5.1 Binomial Distribution

1.5.2 Poisson Distribution

1.5.3 ...