1: \begin{abstract}

2: We consider the problem of inference in discrete probabilistic models, that is, distributions over subsets of a finite ground set.

3: These encompass a range of well-known models in machine learning, such as determinantal point processes and Ising models.

4: Locally-moving Markov chain Monte Carlo algorithms, such as the Gibbs sampler, are commonly used for inference in such models, but their convergence is, at times, prohibitively slow.

5: This is often caused by state-space bottlenecks that greatly hinder the movement of such samplers.

6: We propose a novel sampling strategy that uses a specific mixture of product distributions to propose global moves and, thus, accelerate convergence.

7: Furthermore, we show how to construct such a mixture using semigradient information.

8: We illustrate the effectiveness of combining our sampler with existing ones, both theoretically on an example model, as well as practically on three models learned from real-world data sets.

9: \end{abstract}