8.1 What Is Entropy?
Entropy is commonly referred to as a measure of disorder or information capacity of a communication channel. Entropy as defined by Alfréd Rényi is called
Rényi Entropy with a parameter alpha. There are an infinite number of entropy measures based on that value that can take on any nonnegative real value. The equation is
H is the symbol for entropy. X is the symbol ...