Skip to Main Content
Regression Analysis by Example, 4th Edition
book

Regression Analysis by Example, 4th Edition

by Samprit Chatterjee, Ali S. Hadi
July 2006
Beginner content levelBeginner
408 pages
10h 3m
English
Wiley-Interscience
Content preview from Regression Analysis by Example, 4th Edition

CHAPTER 10

BIASED ESTIMATION OF REGRESSION COEFFICIENTS

10.1 INTRODUCTION

It was demonstrated in Chapter 9 that when multicollinearity is present in a set of predictor variables, the ordinary least squares estimates of the individual regression coefficients tend to be unstable and can lead to erroneous inferences. In this chapter, two alternative estimation methods that provide a more informative analysis of the data than the OLS method when multicollinearity is present are considered. The estimators discussed here are biased but tend to have more precision (as measured by mean square error) than the OLS estimators (see Draper and Smith (1998), McCallum (1970), and Hoerl and Kennard (1970)). These alternative methods do not reproduce the estimation data as well as the OLS method; the sum of squared residuals is not as small and, equivalently, the multiple correlation coefficient is not as large. However, the two alternatives have the potential to produce more precision in the estimated coefficients and smaller prediction errors when the predictions are generated using data other than those used for estimation.

Unfortunately, the criteria for deciding when these methods give better results than the OLS method depend on the true but unknown values of the model regression coefficients. That is, there is no completely objective way to decide when OLS should be replaced in favor of one of the alternatives. Nevertheless, when multicollinearity is suspected, the alternative methods of ...

Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.
Start your free trial

You might also like

Regression Analysis

Regression Analysis

J. Holton Wilson
Regression Analysis

Regression Analysis

J. Holton Wilson, Barry P. Keating, Mary Beal
Regression Analysis with R

Regression Analysis with R

Giuseppe Ciaburro, Pierre Paquay, Manoj Kumar, Shaikh Salamatullah
Solutions Manual to Accompany Introduction to Linear Regression Analysis, 5th Edition

Solutions Manual to Accompany Introduction to Linear Regression Analysis, 5th Edition

Ann G. Ryan, Douglas C. Montgomery, Elizabeth A. Peck, G. Geoffrey Vining, Anne G. Ryan

Publisher Resources

ISBN: 9780471746966Purchase book