1: \begin{abstract}

2: 

3: The Alternating Direction Method of Multipliers (ADMM) has now days gained a substantial attention for solving large-scale machine learning and signal processing problems due to the relative simplicity. However, the two-block structure of the classical ADMM still limits the size of the real problems being solved. When one forces a more-than-two-block structure, the convergence speed slows down greatly as observed in practice. Recently, a randomly assembled cyclic multi-block ADMM (RAC-MBADMM) was developed by  the authors for solving general convex quadratic optimization problems where the number of blocks can go greater than two so that each sub-problem has a much smaller size and can be solved much more efficiently. In this paper, we apply this method to solving few selected machine learning and statistic problems related to convex quadratic optimization, such as Linear Regression, LASSO, Elastic-Net, and SVM. We use our  solver to conduct multiple numerical tests, solving both synthetic and large-scale bench-mark problems. Our results show that RAC-MBADMM could significantly outperform other optimization algorithms/codes designed to solve these machine learning problems in both solution time and quality, and match up the performance of the best tailored methods such as Glmnet or LIBSVM. In certain problem regions, e.g., for problems with high dimensional features, RAC-MBADMM also achieves a better performance than that of tailored methods.

4: \end{abstract}

5: