Updating Schemes, Correlation Structure, Blocking and Parameterization for the Gibbs Sampler

Journal of the Royal Statistical Society: Series B (Statistical Methodology) · 1997 · Volume 59 · Issue 2

Abstract

In this paper many convergence issues concerning the implementation of the Gibbs sampler are investigated. Exact computable rates of convergence for Gaussian target distributions are obtained. Different random and non-random updating strategies and blocking combinations are compared using the rates. The effect of dimensionality and correlation structure on the convergence rates are studied. Some examples are considered to demonstrate the results. For a Gaussian image analysis problem several updating strategies are described and compared. For problems in Bayesian linear models several possible parameterizations are analysed in terms of their convergence rates characterizing the optimal choice.

Keywords

Bayesian Inference, Blocking, Correlation Structure, Gaussian Distribution, Gibbs Sampler, Markov Chain Monte Carlo Method, Markov Random Field, Parameterization, Random Scan, Rates of Convergence, Stochastic Relaxation, Updating Schemes

Enable JavaScript for citation tools and additional paper interactions.