f2988318dc881c92.tex
1: \begin{abstract}
2:   Structured output prediction is an important machine learning problem
3:   both in theory and practice, and the max-margin Markov network (\mcn)
4:   is an effective approach.  All state-of-the-art algorithms for
5:   optimizing \mcn\ objectives take at least $O(1/\epsilon)$ number of
6:   iterations to find an $\epsilon$ accurate solution.  Recent results in
7:   structured optimization suggest that faster rates are possible by
8:   exploiting the structure of the objective function. Towards this end
9:   \cite{Nesterov05} proposed an excessive gap reduction technique based
10:   on Euclidean projections which converges in $O(1/\sqrt{\epsilon})$
11:   iterations on strongly convex functions. Unfortunately when applied to
12:   \mcn s, this approach does not admit graphical model factorization
13:   which, as in many existing algorithms, is crucial for keeping the cost
14:   per iteration tractable.  In this paper, we present a new excessive
15:   gap reduction technique based on Bregman projections which admits
16:   graphical model factorization naturally, and converges in
17:   $O(1/\sqrt{\epsilon})$ iterations. Compared with existing algorithms,
18:   the convergence rate of our method has better dependence on $\epsilon$
19:   and other parameters of the problem, and can be easily kernelized.
20: \end{abstract}
21: