5467a52b3e19d455.tex
1: \begin{abstract}
2:   The graphical lasso \citep{BGA2008,FHT2007a} is a popular approach
3:   for learning the structure in an undirected Gaussian graphical
4:   model, using $\ell_1$ regularization to control the number of zeros
5:   in the precision matrix ${\B\Theta}={\B\Sigma}^{-1}$.  The R
6:   package \GL\ is popular, fast, and allows one to efficiently build a
7:   path of models for different values of the tuning parameter.
8:   Convergence of \GL\ can be tricky; the converged precision matrix
9:   might not be the inverse of the estimated covariance, and
10:   occasionally it fails to converge with warm starts. In this paper we
11:   explain this behavior, and propose new algorithms that appear to
12:   outperform \GL.
13: 
14:   We show that in fact \GL\ is solving the {\em dual} of the graphical
15:   lasso penalized likelihood, by block coordinate descent. In this
16:   dual, the target of estimation is $\B\Sigma$, the covariance matrix,
17:   rather than the precision matrix $\B\Theta$.  We propose  similar
18:   primal algorithms \PGL\ and \DPGL, that also operate by block-coordinate descent,
19:   where $\B\Theta$ is the optimization target.  We study all of these
20:   algorithms, and in particular different approaches to solving their
21:   coordinate subproblems.  We conclude that \DPGL\ is
22:   superior from several points of view.
23: \end{abstract}