1: \begin{abstract}
2: \small{ %
3: We propose \emph{a fully-corrective generalized conditional gradient method} (FC-GCG) for the minimization of the sum of a smooth, convex loss function and a convex one-homogeneous regularizer over a Banach space. The algorithm relies on the mutual update of a finite set~$\mathcal{A}_k$ of extremal points of the unit ball of the regularizer and of an iterate~$u_k \in \operatorname{cone}(\mathcal{A}_k)$. Each iteration requires the solution of one linear problem to update~$\mathcal{A}_k$ and of one finite dimensional convex minimization problem to update the iterate. Under standard hypotheses on the minimization problem we show that the algorithm converges sublinearly to a solution. Subsequently, imposing additional assumptions on the associated dual variables, this is improved to a linear rate of convergence. The proof of both results relies on two key observations: First, we prove the equivalence of the considered problem to the minimization of a lifted functional over a particular space of Radon measures using Choquet's theorem. Second, the FC-GCG algorithm is connected to a \emph{Primal-Dual-Active-point Method} (PDAP) on the lifted problem for which we finally derive the desired convergence rates.
4:
5:
6:
7: \vskip .3truecm \noindent Key words: non-smooth optimization, conditional gradient method, sparsity, Choquet's theorem.
8:
9: \vskip.1truecm \noindent 2020 Mathematics Subject Classification:
10: 65J22, %
11: 65K05, %
12: 52A41, %
13: 46G12, %
14: 46A55. %
15:
16: %
17: %
18: %
19: %
20: %
21: %
22: %
23: %
24: %
25: %
26: %
27: %
28: %
29: %
30: %
31: %
32: }
33: \end{abstract}
34: