An Empirical Bayes Approach to Multiple Linear Regression
The Annals of Statistics · 1973 · Volume 1 · Issue 1
Abstract
We consider estimation (subject to quadratic loss) of the vector of coefficients of a multiple linear regression model in which the error vector is assumed to have 0 mean and covariance matrix $\sigma^2 I$ but is not assumed to take on a specific parametric form, e.g., Normal. The vector of coefficients is taken to be randomly distributed according to some unknown prior. Restricted minimax solutions are exhibited relative to equivalence classes on the space of all prior probability distributions which group distributions with the same specified moments. In the context of the classic Empirical Bayes formulation, we determine restricted asymptotically optimal estimators--i.e., decision functions whose Bayes risks converge to the risk of the restricted minimax decision at each component stage.
Keywords
62C10, 62G05, 62J05, Empirical Bayes, regression, restricted minimax, Stein-James estimators
Enable JavaScript for citation tools and additional paper interactions.