O'Reilly logo

Regression Analysis with R by Giuseppe Ciaburro

Stay ahead with the world's most comprehensive technology and business learning platform.

With Safari, you learn the way you learn best. Get unlimited access to videos, live online training, learning paths, books, tutorials, and more.

Start Free Trial

No credit card required

Lasso regression

In the previous section, we saw Ridge regression: this is a method for regularization and for avoiding overfitting. In Ridge regression, the regression coefficients are shrunk by introducing a penalty, as follows:

>

Here, the term λβ12 is a shrinkage penalty that decreases when the β parameters withdraw (shrink) towards zero. The Lasso regression is a shrinkage method like Ridge, with subtle but important differences. The Lasso estimate is defined by the following equation:

Here, the term λ|β1| is a shrinkage penalty for the ...

With Safari, you learn the way you learn best. Get unlimited access to videos, live online training, learning paths, books, interactive tutorials, and more.

Start Free Trial

No credit card required