Coordinate-Free Ridge Regression Bounds

Abstract

The dependence of ridge-regression estimates on the choice of parameterization is defined with reference to the hull of all possible ridge estimates for all possible parameterizations. A reanalysis of Hoerl and Kennard's (1970) 10-factor example and Marquardt and Snee's (1975) acetylene data reveals that most conclusions depend on the parameterization.