1: \begin{abstract}
2: Conditional Gradients (aka Frank-Wolfe algorithms) form a classical
3: set of methods for constrained smooth convex minimization due to
4: their simplicity, the absence of projection steps, and competitive
5: numerical performance. While the vanilla Frank-Wolfe algorithm only
6: ensures a worst-case rate of $\mathcal{O}(1/\epsilon)$, various
7: recent results have shown that for strongly convex functions on
8: polytopes, the method can be slightly modified to achieve
9: linear convergence. However, this still leaves a huge gap between
10: sublinear $\mathcal{O}(1/\epsilon)$ convergence and linear
11: $\mathcal{O}(\log 1/\epsilon)$ convergence to reach an
12: $\epsilon$-approximate
13: solution.
14: Here, we present a new variant of Conditional Gradients, that can
15: dynamically adapt to the function's geometric properties using
16: restarts and smoothly interpolates between the sublinear and linear
17: regimes.
18: Similarly, the vanilla Frank-Wolfe method has a
19: $\mathcal{O}(1/\sqrt{\epsilon})$ convergence rate when both
20: constraint set and objective function are strongly convex. We show
21: that relaxing the strong convexity assumption interpolates between
22: various known rates and that similar interpolated convergence rates
23: are obtained when strong convexity of the constraint set is relaxed
24: to uniform convexity.
25: \end{abstract}
26: