1: \begin{abstract}
2: This article introduces new multiplicative updates for nonnegative matrix
3: factorization with the $\beta$-divergence and sparse regularization of one of the
4: two factors (say, the activation matrix).
5: It is well known that the norm of the other factor (the dictionary matrix)
6: needs to be controlled in order to avoid an ill-posed formulation.
7: Standard practice consists in constraining the columns of the dictionary to
8: have unit norm, which leads to a nontrivial optimization problem.
9: Our approach leverages a reparametrization of the original problem into the
10: optimization of an equivalent scale-invariant objective function.
11: From there, we derive block-descent majorization-minimization algorithms that
12: result in simple multiplicative updates for either $\ell_{1}$-regularization or the
13: more ``aggressive'' log-regularization.
14: In contrast with other state-of-the-art methods, our algorithms are universal
15: in the sense that they can be applied to any $\beta$-divergence (i.e., any value
16: of $\beta$) and that they come with convergence guarantees.
17: We report numerical comparisons with existing heuristic and Lagrangian methods
18: using various datasets: face images, an audio spectrogram, hyperspectral data,
19: and song play counts.
20: We show that our methods obtain solutions of similar quality at convergence
21: (similar objective values) but with significantly reduced CPU times.
22: \end{abstract}
23: