Appendix B
Autocorrelation and Partial Autocorrelation
B.1 Partial Autocorrelation
Definition
The (theoretical) partial autocorrelation at lag h > 0, rX(h), of a second-order stationary process X = (Xt) with nondegenerate linear innovations,1 is the correlation between
and
where EL(Y|Y1,…, Yk) denotes the linear regression of a square integrable variable Y on variables Y1,…,Yk. Let
The number rX(h) can be interpreted as the residual correlation between Xt and Xt−h, after the linear influence of the intermediate variables Xt−1, Xt−2,…, Xt−h+1 has been subtracted. Assume that (Xt) is centered, and consider the linear regression of Xt on Xt−1,…, Xt−h:
We have
and
Proof of (B.3) and (B.4). We obtain (B.3) from (B.2), using the linearity of EL(·|Xt−1