Optimal scaling of discrete approximations to Langevin diffusions

Abstract

We consider the optimal scaling problem for proposal distributions in Hastings–Metropolis algorithms derived from Langevin diffusions. We prove an asymptotic diffusion limit theorem and show that the relative efficiency of the algorithm can be characterized by its overall acceptance rate, independently of the target distribution. The asymptotically optimal acceptance rate is 0.574. We show that, as a function of dimensionn, the complexity of the algorithm isO(n1/3), which compares favourably with theO(n) complexity of random walk Metropolis algorithms. We illustrate this comparison with some example simulations.