Common Errors in Statistics (and How to Avoid Them), 4th Edition
by Phillip I. Good, James W. Hardin
LEAST-ABSOLUTE-DEVIATION REGRESSION
The two most popular linear regression methods for estimating model coefficients are referred to as ordinary-least-squares (OLS) and least-absolute-deviation (LAD) goodness of fit, respectively. Because they are popular, a wide selection of computer software is available to help us do the calculations.
With least-squares goodness of fit, we seek to minimize the sum
![]()
where Yi denotes the variable we wish to predict and Xi the corresponding value of the predictor on the ith occasion. With the LAD method, we seek to minimize the sum of the absolute deviations between the observed and the predicted value:
![]()
Those who have taken calculus know the OLS minimum is obtained when
![]()
that is, when
![]()
and
![]()
Least-absolute-deviation regression (LAD) attempts to correct one of the major flaws of OLS, that of sometimes giving excessive weight to extreme values. The LAD method solves for those values of the coefficients in the regression equation for which the sum of the ...
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.
Read now
Unlock full access