1: \begin{abstract}
2:
3: Recent developments in differentially private (DP) machine
4: learning and DP Bayesian learning have enabled learning under
5: strong privacy guarantees for the training data subjects.
6: In this paper, we further extend the applicability of DP Bayesian
7: learning by presenting the first general DP Markov chain Monte Carlo (MCMC)
8: algorithm whose privacy-guarantees are not subject to unrealistic assumptions on
9: Markov chain convergence and that is applicable to posterior inference in arbitrary models. Our
10: algorithm is based on a decomposition of the Barker acceptance test
11: that allows evaluating the Rényi DP privacy cost of the
12: accept-reject choice. We further show how to improve the DP
13: guarantee through data subsampling and approximate acceptance tests.
14:
15: \end{abstract}
16: