a3ee50db66469761.tex
1: \begin{abstract}
2:   The graphical lasso \citep{FHT2007a} is an algorithm 
3: for learning the structure in an undirected Gaussian graphical
4:   model, using $\ell_1$ regularization to control the number of zeros
5:   in the precision matrix ${\B\Theta}={\B\Sigma}^{-1}$
6:   \citep{BGA2008,yuan_lin_07}. The {\texttt R}
7:   package \GL\ \citep{FHT2007a} is popular, fast, and allows one to efficiently build a
8:   path of models for different values of the tuning parameter.
9:   Convergence of \GL\ can be tricky; the converged precision matrix
10:   might not be the inverse of the estimated covariance, and
11:   occasionally it fails to converge with warm starts. In this paper we
12:   explain this behavior, and propose new algorithms that appear to
13:   outperform \GL.
14: 
15:   By studying the ``normal equations'' we see that, \GL\ is solving the {\em dual} of the graphical
16:   lasso penalized likelihood, by block coordinate ascent; a result which can also be found in \cite{BGA2008}.
17:   %different techniques %, we  arrive at similar conclusions appearing in \cite{BGA2008}. In this
18:   In this dual, the target of estimation is $\B\Sigma$, the covariance matrix,
19:   rather than the precision matrix $\B\Theta$.  We propose  similar
20:   primal algorithms \PGL\ and \DPGL, that also operate by block-coordinate descent,
21:   where $\B\Theta$ is the optimization target.  We study all of these
22:   algorithms, and in particular different approaches to solving their
23:   coordinate sub-problems.  We conclude that \DPGL\ is
24:   superior from several points of view.
25: \end{abstract}