1: \begin{abstract}

2: Use of continuous shrinkage priors --- with a ``spike'' near zero and heavy-tails towards infinity ---  is an increasingly popular approach to induce sparsity in parameter estimates.

3: When the parameters are only weakly identified by the likelihood, however, the posterior may end up with tails as heavy as the prior, jeopardizing robustness of inference.

4: A natural solution is to ``shrink the shoulders'' of a shrinkage prior by lightening up its tails beyond a reasonable parameter range, yielding a \textit{regularized} version of the prior.

5: We develop a regularization approach which, unlike previous proposals, preserves computationally attractive structures of original shrinkage priors.

6: We study theoretical properties of the Gibbs sampler on resulting posterior distributions, with emphasis on convergence rates of the \polyagamma{} Gibbs sampler for sparse logistic regression.

7: Our analysis shows that the proposed regularization leads to geometric ergodicity under a broad range of global-local shrinkage priors.

8: Essentially, the only requirement is for the prior $\localPriorInAbstract(\cdot)$ on the local scale $\lshrink$ to satisfy $\localPriorInAbstract(0) < \infty$.

9: If $\localPriorInAbstract(\cdot)$ further satisfies $\lim_{\lshrink \to 0} \localPriorInAbstract(\lshrink) / \lshrink^\bridgeExponent < \infty$ for $\bridgeExponent > 0$, as in the case of Bayesian bridge priors, we show the sampler to be uniformly ergodic.

10: \end{abstract}

11: