1: \begin{abstract}

2: Low-rank representation (LRR) is an effective method for subspace

3: clustering and has found wide applications in computer vision and

4: machine learning. The existing LRR solver is based on the

5: alternating direction method (ADM). It suffers from $O(n^3)$

6: computation complexity due to the matrix-matrix multiplications

7: and matrix inversions, even if partial SVD is used. Moreover,

8: introducing auxiliary variables also slows down the convergence.

9: Such a heavy computation load prevents LRR from large scale

10: applications. In this paper, we generalize ADM by linearizing the

11: quadratic penalty term and allowing the penalty to change

12: adaptively. We also propose a novel rule to update the penalty

13: such that the convergence is fast. With our linearized ADM with

14: adaptive penalty (LADMAP) method, it is unnecessary to introduce

15: auxiliary variables and invert matrices. The matrix-matrix

16: multiplications are further alleviated by using the skinny SVD

17: representation technique. As a result, we arrive at an algorithm

18: for LRR with complexity $O(rn^2)$, where $r$ is the rank of the

19: representation matrix. Numerical experiments verify that for LRR

20: our LADMAP method is much faster than state-of-the-art algorithms.

21: Although we only present the results on LRR, LADMAP actually can

22: be applied to solving more general convex programs.

23: \end{abstract}