901c1b0bb1dfcdad.tex
1: \begin{abstract}
2:   This article introduces new multiplicative updates for nonnegative matrix
3:   factorization with the $\beta$-divergence and sparse regularization of one of the
4:   two factors (say, the activation matrix).
5:   It is well known that the norm of the other factor (the dictionary matrix)
6:   needs to be controlled in order to avoid an ill-posed formulation.
7:   Standard practice consists in constraining the columns of the dictionary to
8:   have unit norm, which leads to a nontrivial optimization problem.
9:   Our approach leverages a reparametrization of the original problem into the
10:   optimization of an equivalent scale-invariant objective function.
11:   From there, we derive block-descent majorization-minimization algorithms that
12:   result in simple multiplicative updates for either $\ell_{1}$-regularization or the
13:   more ``aggressive'' log-regularization.
14:   In contrast with other state-of-the-art methods, our algorithms are universal
15:   in the sense that they can be applied to any $\beta$-divergence (i.e., any value
16:   of $\beta$) and that they come with convergence guarantees.
17:   We report numerical comparisons with existing heuristic and Lagrangian methods
18:   using various datasets: face images, an audio spectrogram, hyperspectral data,
19:   and song play counts.
20:   We show that our methods obtain solutions of similar quality at convergence
21:   (similar objective values) but with significantly reduced CPU times.
22: \end{abstract}
23: