095bc0c209f13c56.tex
1: \begin{abstract}%
2: This paper focuses on gradient-based Variational Inference for $\alpha$-divergence minimisation. More precisely, we are interested in studying algorithms making it possible to optimise the mixture weights of any given mixture model, without any information on the underlying distribution of its mixture components parameters. The Power Descent is one such algorithm and we establish in our work its
3: convergence towards the optimal mixture weights when $\alpha <1$ under alleviated assumptions. We also investigate the link between Power Descent and Entropic Mirror Descent: this allows us to introduce the Renyi Descent, for which we prove an $O(1/N)$ convergence rate. We then provide some numerical experiments to illustrate the behavior of these two algorithms in practice.
4: \end{abstract}