Scholion.ai

Iterative Weighted Least Squares Estimation in Heteroscedastic Linear Models

Peter M. Hooper

Journal of the American Statistical Association · 1993 · Volume 88 · Issue 421

DOI: 10.1080/01621459.1993.10594309

Abstract

This article addresses the problem of choosing weights for iterative weighted least squares estimation in heteroscedastic linear models. An asymptotically optimal method for determining weights at each iteration is derived under a Bayesian model for the variances. The method uses a compromise between model-based and model-free variance estimates. Consider a heteroscedastic linear regression model in which responses are grouped so that the variance is constant within each group. Let β denote the vector of regression parameters and let θ denote a vector of parameters determining a prior distribution for the variances. Iterative weighted least squares estimators are defined as follows. Given estimates and , calculate a weight for the i th group as a function of , the values in the i th group of the predictor variables, and the average of the squared residuals from the estimated mean responses in the i th group. Given weights, calculate the weighted least squares estimate and a new estimate . Continue until converges. We derive the asymptotically optimal weight function under an inverse gamma model for the variances. The resulting weights have a simple form. At each iteration the inverse weight for the i th group is a weighted average of the average squared residual and a variance estimate based on the inverse gamma model.

Enable JavaScript for citation tools and additional paper interactions.