1: \begin{abstract}

2: Low-rank modeling has a lot of important applications in machine learning, computer vision and

3: social network analysis. While the matrix rank is often approximated by the convex nuclear

4: norm, the use of nonconvex low-rank regularizers has demonstrated better recovery performance.

5: However, the resultant optimization problem is

6: much more challenging.

7: A very recent state-of-the-art is based on the proximal gradient algorithm.

8: However, it requires an expensive full SVD in each proximal step.

9: In this paper, we show that 

10: for many commonly-used nonconvex low-rank regularizers, 

11: a cutoff can be derived to automatically threshold the singular

12: values obtained from the proximal operator. This allows the use of

13: power method to approximate the SVD efficiently.

14: Besides, the proximal operator can be reduced to that of a much smaller matrix

15: projected onto this leading subspace.

16: Convergence, with a rate of $O(1/T)$ where $T$ is the number of iterations,

17: can be guaranteed. Extensive experiments are performed on matrix completion and robust principal component analysis. The proposed method achieves

18: significant speedup over the state-of-the-art. Moreover, the matrix solution obtained is more

19: accurate and has a lower rank than that of the traditional nuclear norm regularizer.

20: \footnote{This is the long version of conference paper appeared in ICDM 2015 \cite{yao2015fast};

21: 	Code is available at: \url{https://github.com/quanmingyao/FaNCL}.}

22: \end{abstract}

23: