c2b9808c36be0b45.tex
1: \begin{abstract}
2: The block coordinate descent (BCD) method is widely used for
3: minimizing a continuous function $f$ of several block variables. At each
4: iteration of this method, a single block of variables is optimized,
5: while the remaining variables are held fixed. To ensure the
6: convergence of the BCD method, the subproblem to be optimized in
7: each iteration needs to be solved {\it exactly} to its {\it unique}
8: optimal solution. Unfortunately, these requirements are often too
9: restrictive for many practical scenarios. In this paper, we study an
10: alternative inexact BCD approach which updates the variable blocks
11: by successively minimizing a sequence of approximations of $f$ which are
12: either locally tight upper bounds of $f$ or strictly convex local approximations
13: of $f$. We focus on characterizing the
14: convergence properties for a fairly wide class of such methods,
15: especially for the cases where the objective functions are either
16: non-differentiable or nonconvex. Our results unify and extend the
17: existing convergence results for many classical algorithms such as the BCD method, the
18: difference of convex functions (DC) method, the expectation maximization
19: (EM) algorithm, as well as the alternating proximal minimization algorithm.
20: \end{abstract}
21: