1: \begin{abstract}\noindent

2: Markov chain Monte Carlo (MCMC) lies at the core of modern Bayesian methodology, much of which would be impossible without it. Thus, the convergence properties of MCMCs have received significant attention, and in particular, proving (geometric) ergodicity is of critical interest. Trust in the ability of MCMCs to sample from modern-day high-dimensional posteriors, however, has been limited by a widespread perception that chains typically experience serious convergence problems in such regimes. Though there may be a good practical understanding of convergence problems (and the associated role of priors) in some settings, a clear theoretical characterization of these problems is not available. Current methods for obtaining convergence rates of such MCMCs typically proceed as if the dimension of the parameter, $p$, and sample size, $n$, are fixed. In this paper, we first demonstrate that contemporary methods have serious limitations when the dimension grows. We then propose a framework for rigorously establishing the convergence behavior of commonly used high-dimensional  MCMCs. In particular, we demonstrate theoretically the precise nature and severity of the convergence problems of popular MCMCs when implemented in high dimensions, including phase transitions in the convergence rates in various $n$~and~$p$ regimes. We then proceed to show a universality result for the convergence rate of MCMCs across an entire spectrum of models. We also show that convergence problems in some important models effectively eliminate the apparent safeguard of geometric ergodicity. We then demonstrate theoretical principles by which MCMCs can be constructed and analyzed to yield bounded geometric convergence rates (essentially recovering geometric ergodicity) even as the dimension~$p$ grows without bound. Additionally, we propose a diagnostic tool for establishing convergence (or the lack thereof) for high-dimensional MCMCs.

3: \end{abstract}

4: