6798efe1eb2d352a.tex
1: \begin{abstract}
2:   Conditional Gradients (aka Frank-Wolfe algorithms) form a classical
3:   set of methods for constrained smooth convex minimization due to
4:   their simplicity, the absence of projection steps, and competitive
5:   numerical performance. While the vanilla Frank-Wolfe algorithm only
6:   ensures a worst-case rate of $\mathcal{O}(1/\epsilon)$, various
7:   recent results have shown that for strongly convex functions on
8:   polytopes, the method can be slightly modified to achieve
9:   linear convergence. However, this still leaves a huge gap between
10:   sublinear $\mathcal{O}(1/\epsilon)$ convergence and linear
11:   $\mathcal{O}(\log 1/\epsilon)$ convergence to reach an
12:   $\epsilon$-approximate
13:   solution.
14:   Here, we present a new variant of Conditional Gradients, that can
15:   dynamically adapt to the function's geometric properties using
16:   restarts and smoothly interpolates between the sublinear and linear
17:   regimes.
18:   Similarly, the vanilla Frank-Wolfe method has a
19:   $\mathcal{O}(1/\sqrt{\epsilon})$ convergence rate when both
20:   constraint set and objective function are strongly convex. We show
21:   that relaxing the strong convexity assumption interpolates between
22:   various known rates and that similar interpolated convergence rates
23:   are obtained when strong convexity of the constraint set is relaxed
24:   to uniform convexity.
25: \end{abstract}
26: