f0e7511ffdee1975.tex
1: \begin{abstract}
2: We demonstrate the use of a variational method to determine a quantitative lower 
3: bound on the rate of convergence of Markov Chain Monte Carlo (MCMC) algorithms as
4: a function of the target density and proposal density. 
5: The bound relies on approximating the second largest eigenvalue in the spectrum
6: of the MCMC operator using a variational principle and the approach is applicable
7: to problems with continuous state spaces. 
8: We apply the method to one dimensional examples with Gaussian and
9: quartic target densities, and we contrast the performance of the 
10: Random Walk Metropolis-Hastings (RWMH) algorithm with a ``smart'' variant 
11: that incorporates gradient information into the trial moves, a generalization
12: of the Metropolis Adjusted Langevin Algorithm (MALA). 
13: We find that the variational method agrees quite closely with numerical 
14: simulations. We also see that the smart MCMC algorithm often fails to 
15: converge geometrically in the tails of the target density except in 
16: the simplest case we examine, and even then care must be taken to choose 
17: the appropriate scaling of the deterministic and random parts of the
18: proposed moves. Again, this calls into question the utility of smart MCMC in more
19: complex problems.
20: Finally, we apply the same method to approximate the rate of convergence in 
21: multidimensional Gaussian problems with and without importance sampling.
22: There we demonstrate the necessity of importance sampling for target densities 
23: which depend on variables with a wide range of scales.
24: 
25: \end{abstract}
26: