1: \begin{abstract}

2:     % We consider a class of problems where Frank-Wolfe type of algorithm could be beneficial for the simple structure of the solution. In the setting that applies to Elastic Net, SVM, and phase retrieval etc, we propose a variant of Frank-Wolfe algorithm that not only achieves linear convergence, but also requires very cheap computational cost that is (feature) dimension free under some conditions. Empirical studies on various datasets verify our algorithm outperforms several state-of-the-art methods on (multi-class) classification tasks. 

3: 

4:     % Can we use the conditional gradient to highly reduce the per iteration cost, while yielding comparable progress to achieve linear convergence rate?

5:     % For a class of problems that covers Elastic Net, SVM, and phase retrieval etc, we answer the question affirmatively, by proposing a variant of the Frank-Wolfe algorithm. 

6:     % This method converges linearly and has a per iteration cost depends on the structural complexity of the solution (sparsity/rank) instead of the ambient dimension.

7:     % Empirical studies on various datasets verify that our algorithm outperforms the state-of-the-art methods on (multi-class) classification tasks.

8: 

9:     We propose a variant of the Frank-Wolfe algorithm for solving a class of sparse/low-rank optimization problems. Our formulation includes Elastic Net, regularized SVMs and phase retrieval as special cases. The proposed Primal-Dual Block Frank-Wolfe algorithm reduces the per-iteration cost while maintaining linear convergence rate.

10:     The per iteration cost of our method depends on the structural complexity of the solution (i.e. sparsity/low-rank) instead of the ambient dimension.

11:     We empirically show that our algorithm outperforms the state-of-the-art methods on (multi-class) classification tasks.

12: \end{abstract}

13: