Probability, Random Variables, and Random Processes: Theory and Signal Processing Applications
by John J. Shynk
5.18 CORRELATION COEFFICIENTS
Correlation is an important measure of the degree to which two or more random variables have some relationship. For example, if X and Y are correlated, then outcomes of X might be used to predict outcomes of Y. Correlation also means that if X is conditioned on Y (or vice versa), then the conditional pdf of X given Y differs from the marginal pdf. We observed this previously in Chapter 4 for the bivariate Gaussian pdf in Example 4.5. In this section, we discuss normalized measures of correlation that can also be used to generate random variables with a specified degree of correlation.
Definition: Pearson's Correlation Pearson's correlation coefficient for random variables X and Y is
(5.231)
Generally, when a correlation coefficient is mentioned, it refers to Pearson's
(and not the other coefficients described below).
Due to the normalization,
is dimensionless and bounded, which allows for more meaningful interpretations of the degree of correlation between two random variables.
Theorem 5.8 The correlation coefficient is bounded as follows:
(5.232)
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.
Read now
Unlock full access