1: \begin{abstract}
2: There is a growing interest in the literature for adaptive Markov chain
3: Monte Carlo methods
4: based on sequences of random transition kernels $\{P_n\}$ where the
5: kernel $P_n$ is allowed
6: to have an invariant distribution $\pi_n$ not necessarily equal to the
7: distribution of
8: interest $\pi$ (target distribution). These algorithms are designed
9: such that as $n\to\infty$,
10: $P_n$ converges to $P$, a kernel that has the correct invariant
11: distribution $\pi$. Typically,
12: $P$ is a kernel with good convergence properties, but one that cannot
13: be directly implemented.
14: It is then expected that the algorithm will inherit the good
15: convergence properties of $P$.
16: The equi-energy sampler of [\textit{Ann. Statist.} \textbf{34} (2006)
17: 1581--1619] is an example of this type of adaptive MCMC.
18: We show in this paper that the asymptotic variance of this type of
19: adaptive MCMC is always
20: at least as large as the asymptotic variance of the Markov chain with
21: transition kernel $P$.
22: We also show by simulation that the difference can be substantial.
23: \end{abstract}