20d748377afcf5a9.tex
1: \begin{abstract}
2: We analyze the convergence behaviour of a recently proposed
3:  algorithm for regularized estimation called Dual Augmented Lagrangian
4:  (DAL).
5: %
6: Our analysis is based on a new interpretation of DAL as a proximal
7:  minimization algorithm.
8: %
9: We theoretically show
10:  under some conditions that DAL converges super-linearly in a
11:  non-asymptotic and global sense. Due to a special modelling of sparse
12:  estimation problems in the context of machine learning,
13:  the assumptions we make are milder and more natural than those made in
14:  conventional analysis of augmented Lagrangian algorithms.
15: %
16: In addition, the new interpretation enables us to generalize DAL to wide
17:  varieties of sparse estimation problems.
18: %
19:  We  experimentally confirm our analysis in  a large scale
20:  $\ell_1$-regularized logistic regression problem and   extensively
21:  compare the efficiency of DAL algorithm to previously  proposed
22:  algorithms on both synthetic and benchmark datasets. 
23: \end{abstract}
24: