1: \begin{abstract}
2: Structured output prediction is an important machine learning problem
3: both in theory and practice, and the max-margin Markov network (\mcn)
4: is an effective approach. All state-of-the-art algorithms for
5: optimizing \mcn\ objectives take at least $O(1/\epsilon)$ number of
6: iterations to find an $\epsilon$ accurate solution. Recent results in
7: structured optimization suggest that faster rates are possible by
8: exploiting the structure of the objective function. Towards this end
9: \cite{Nesterov05} proposed an excessive gap reduction technique based
10: on Euclidean projections which converges in $O(1/\sqrt{\epsilon})$
11: iterations on strongly convex functions. Unfortunately when applied to
12: \mcn s, this approach does not admit graphical model factorization
13: which, as in many existing algorithms, is crucial for keeping the cost
14: per iteration tractable. In this paper, we present a new excessive
15: gap reduction technique based on Bregman projections which admits
16: graphical model factorization naturally, and converges in
17: $O(1/\sqrt{\epsilon})$ iterations. Compared with existing algorithms,
18: the convergence rate of our method has better dependence on $\epsilon$
19: and other parameters of the problem, and can be easily kernelized.
20: \end{abstract}
21: