e6a399e18e1bf03c.tex
1: \begin{abstract}
2: Both the smoothly clipped absolute deviation (SCAD) and  the
3: minimax concave penalty (MCP) penalized linear regression models are capable of dealing with variable selection and parameter estimation  simultaneously.
4: Theoretically, these  two models enjoy the oracle
5: property even in the high dimensional settings where  the number of predictors $p$ may be much larger than the number of  observations  $n$. However,  numerically,
6: it is quite challenging to  develop fast and stable algorithms due to  their  non-convexity and  non-smoothness. In this paper we develop a  fast algorithm  for
7: SCAD and MCP penalized  problems.
8: First, we derive that the global minimizers of both models are roots of some
9: nonsmooth equations.  Then, Semi-smooth Newton (SSN) algorithm is employed   to solve the equations. We prove the local superlinear convergence of SSN algorithm. Computational complexity analysis demonstrates  that the cost of SSN algorithm per iteration is $O(np)$. Combining with the warmstarting  technique  SSN algorithm can be very efficient.   Simulation studies and  real data examples  show that SSN algorithm greatly outperforms coordinate descent in computational efficiency  while reaching comparable accuracy.
10: \end{abstract}