1: \begin{abstract}
2: Non-convex sparsity-inducing penalties have recently received considerable attentions in sparse learning.
3: Recent theoretical investigations have demonstrated their superiority over
4: the convex counterparts in several sparse learning settings. However, solving the non-convex optimization problems
5: associated with non-convex penalties remains a big challenge. A commonly used approach is the Multi-Stage (MS) convex
6: relaxation (or DC programming), which relaxes the original non-convex problem to a sequence of convex problems.
7: This approach is usually not very practical for large-scale problems because its computational cost is a multiple
8: of solving a single convex problem. In this paper, we propose a General Iterative Shrinkage and Thresholding
9: (GIST) algorithm to solve the nonconvex
10: optimization problem for a large class of non-convex penalties. The GIST algorithm iteratively solves a proximal operator problem,
11: which in turn has a closed-form solution for many commonly used penalties. At each outer iteration of the algorithm,
12: we use a line search initialized by the Barzilai-Borwein (BB) rule that allows finding an appropriate step size quickly.
13: The paper also presents a detailed convergence analysis of the GIST algorithm. The efficiency of the proposed algorithm
14: is demonstrated by extensive experiments on large-scale data sets.
15: \end{abstract}