1: \begin{abstract}
2: Markov chain Monte Carlo (MCMC) methods to sample from a probability
3: distribution $\pi$ defined on a space $(\Theta,\mathcal{T})$ consist
4: of the simulation of realisations of Markov chains $\{\theta_{n},n\geq1\}$
5: of invariant distribution $\pi$ and such that the distribution of
6: $\theta_{i}$ converges to $\pi$ as $i\rightarrow\infty$. In practice
7: one is typically interested in the computation of expectations of
8: functions, say $f$, with respect to $\pi$ and it is also required
9: that averages $M^{-1}\sum_{n=1}^{M}f(\theta_{n})$ converge to the
10: expectation of interest. The iterative nature of MCMC makes it difficult
11: to develop generic methods to take advantage of parallel computing
12: environments when interested in reducing time to convergence. While
13: numerous approaches have been proposed to reduce the variance of ergodic
14: averages, including averaging over independent realisations of $\{\theta_{n},n\geq1\}$
15: simulated on several computers, techniques to reduce the ``burn-in''
16: of MCMC are scarce. In this paper we explore a simple and generic
17: approach to improve convergence to equilibrium of existing algorithms
18: which rely on the Metropolis-Hastings (MH) update, the main building
19: block of MCMC. The main idea is to use averages of the acceptance
20: ratio w.r.t. multiple realisations of random variables involved, while
21: preserving $\pi$ as invariant distribution. The methodology requires
22: limited change to existing code, is naturally suited to parallel computing
23: and is shown on our examples to provide substantial performance improvements
24: both in terms of convergence to equilibrium and variance of ergodic
25: averages. In some scenarios gains are observed even on a serial machine.
26: \end{abstract}
27: