1: \begin{abstract}

2: We introduce a generalization of the linearized Alternating Direction Method of Multipliers to optimize a real-valued function $f$ of multiple arguments with potentially multiple constraints $g_\circ$ on each of them.

3: The function $f$ may be nonconvex as long as it is convex in every argument, while the constraints $g_\circ$ need to be convex but not smooth.

4: If $f$ is smooth, the proposed Block-Simultaneous Direction Method of Multipliers (bSDMM) can be interpreted as a proximal analog to inexact coordinate descent methods under constraints.

5: Unlike alternative approaches for joint solvers of multiple-constraint problems, we do not require linear operators $\tL$ of a constraint function $g(\tL\ \cdot)$ to be invertible or linked between each other.

6: bSDMM is well-suited for a range of optimization problems, in particular for data analysis, where $f$ is the likelihood function of a model and $\tL$ could be a transformation matrix describing e.g. finite differences or basis transforms.

7: We apply bSDMM to the Non-negative Matrix Factorization task of a hyperspectral unmixing problem and demonstrate convergence and effectiveness of multiple constraints on both matrix factors.

8: The algorithms are implemented in {\sf python} and released as an open-source package.

9: \keywords{Optimization \and Proximal Algorithms \and Nonconvex Optimization \and Block Coordinate Descent\and Non-negative Matrix Factorization}

10: \end{abstract}

11: