386b8bfc4d753022.tex
1: \begin{abstract}
2: 
3: The sparse nonlinear programming (SNP) problem has wide applications in signal and image processing, machine learning, pattern recognition, finance and management, etc. However, the computational challenge posed by SNP has not yet been well resolved due to the nonconvex and discontinuous $\ell_0$-norm involved. In this paper, we resolve this numerical challenge by developing a fast Newton-type algorithm. As a theoretical cornerstone, we establish a first-order optimality condition for SNP based on the concept of strong $\beta$-Lagrangian stationarity via the Lagrangian function, and reformulate it as a system of nonlinear equations called the Lagrangian equations. The nonsingularity of the corresponding Jacobian is discussed, based on which the Lagrange-Newton algorithm (LNA) is then proposed. Under mild conditions, we establish the local quadratic convergence rate and the iterative complexity estimation of LNA. To further demonstrate the efficiency and superiority of our proposed algorithm, we apply LNA to solve three specific application problems arising from compressed sensing, sparse portfolio selection and sparse principal component analysis, in which significant benefits accrue from the restricted Newton step in LNA.
4: 
5: 
6: \vskip 12pt \noindent {\bf Key words.} {Sparse nonlinear programming, Lagrange equation, the Newton method, Quadratic convergence rate, Application}
7: 
8: \vskip 12pt\noindent {\bf AMS subject classifications. }{90C30, 49M15, 90C46}
9: 
10: \end{abstract}
11: