cf030ae8cfff89e6.tex
1: \begin{abstract}
2: 
3: Stein variational gradient descent (SVGD) refers to a class of methods for Bayesian inference based on interacting particle systems. In this paper, we consider the originally proposed  deterministic dynamics as well as a stochastic variant, each of which represent one of the two main paradigms in Bayesian computational statistics: \emph{variational inference} and \emph{Markov chain Monte Carlo}. As it turns out, these are tightly linked through a correspondence between gradient flow structures and large-deviation principles rooted in statistical physics. To expose this relationship, we develop the cotangent space construction for the Stein geometry, prove its basic properties, and determine the large-deviation functional governing the many-particle limit for the empirical measure. Moreover, we identify the \emph{Stein-Fisher information} (or \emph{kernelised Stein discrepancy}) as its leading order contribution in the long-time and many-particle regime in the sense of $\Gamma$-convergence, shedding some light on the  finite-particle properties of SVGD. Finally, we establish a comparison principle between the Stein-Fisher information and RKHS-norms that might be of independent interest.
4: \\
5: 
6: \noindent \textbf{Keywords:} Stein variational gradient descent, gradient flows, large deviations.
7: \end{abstract}
8: