1: \begin{abstract}

2: Particle-based variational inference methods (ParVIs) such as Stein variational gradient descent (SVGD) update the particles based on the kernelized Wasserstein gradient flow for the Kullback-Leibler (KL) divergence.

3: However, the design of kernels is often non-trivial and can be restrictive for the flexibility of the method.

4: Recent works show that functional gradient flow approximations with quadratic form regularization terms can improve performance.

5: In this paper, we propose a ParVI framework, called generalized Wasserstein gradient descent (GWG), based on a generalized Wasserstein gradient flow of the KL divergence, which can be viewed as a functional gradient method with a broader class of regularizers induced by convex functions.

6: We show that GWG exhibits strong convergence guarantees.

7: We also provide an adaptive version that automatically chooses Wasserstein metric to accelerate convergence.

8: In experiments, we demonstrate the effectiveness and efficiency of the proposed framework on both simulated and real data problems.

9: \end{abstract}

10: