1: \begin{abstract}
2: We consider Markov chain Monte Carlo (MCMC) algorithms for Bayesian high-dimensional regression with
3: continuous shrinkage priors. A common challenge with these
4: algorithms is the choice of the number of iterations to perform. This is
5: critical when each iteration is expensive, as is the
6: case when dealing with modern data sets, such as genome-wide association
7: studies with thousands of rows and up to hundred of thousands of columns. We
8: develop coupling techniques tailored to the setting of high-dimensional
9: regression with shrinkage priors, which enable practical, non-asymptotic
10: diagnostics of convergence without relying on traceplots or long-run
11: asymptotics. By establishing geometric drift and minorization
12: conditions for the algorithm under consideration, we prove that
13: the proposed couplings have finite expected meeting time.
14: Focusing on a class of shrinkage priors which includes the
15: ``Horseshoe'', we empirically demonstrate the scalability of the proposed
16: couplings. A highlight of our findings is that less
17: than 1000 iterations can be enough for a Gibbs sampler to reach stationarity
18: in a regression on $100,000$ covariates. The numerical results also
19: illustrate the
20: impact of the prior on the computational efficiency of the coupling,
21: and suggest the use of priors where the local precisions are
22: Half-t distributed with degree of freedom larger than one.
23: \end{abstract}
24: