1: \begin{abstract}
2: We demonstrate the use of a variational method to determine a quantitative lower
3: bound on the rate of convergence of Markov Chain Monte Carlo (MCMC) algorithms as
4: a function of the target density and proposal density.
5: The bound relies on approximating the second largest eigenvalue in the spectrum
6: of the MCMC operator using a variational principle and the approach is applicable
7: to problems with continuous state spaces.
8: We apply the method to one dimensional examples with Gaussian and
9: quartic target densities, and we contrast the performance of the
10: Random Walk Metropolis-Hastings (RWMH) algorithm with a ``smart'' variant
11: that incorporates gradient information into the trial moves, a generalization
12: of the Metropolis Adjusted Langevin Algorithm (MALA).
13: We find that the variational method agrees quite closely with numerical
14: simulations. We also see that the smart MCMC algorithm often fails to
15: converge geometrically in the tails of the target density except in
16: the simplest case we examine, and even then care must be taken to choose
17: the appropriate scaling of the deterministic and random parts of the
18: proposed moves. Again, this calls into question the utility of smart MCMC in more
19: complex problems.
20: Finally, we apply the same method to approximate the rate of convergence in
21: multidimensional Gaussian problems with and without importance sampling.
22: There we demonstrate the necessity of importance sampling for target densities
23: which depend on variables with a wide range of scales.
24:
25: \end{abstract}
26: