1: \begin{abstract}
2: The graphical lasso \citep{FHT2007a} is an algorithm
3: for learning the structure in an undirected Gaussian graphical
4: model, using $\ell_1$ regularization to control the number of zeros
5: in the precision matrix ${\B\Theta}={\B\Sigma}^{-1}$
6: \citep{BGA2008,yuan_lin_07}. The {\texttt R}
7: package \GL\ \citep{FHT2007a} is popular, fast, and allows one to efficiently build a
8: path of models for different values of the tuning parameter.
9: Convergence of \GL\ can be tricky; the converged precision matrix
10: might not be the inverse of the estimated covariance, and
11: occasionally it fails to converge with warm starts. In this paper we
12: explain this behavior, and propose new algorithms that appear to
13: outperform \GL.
14:
15: By studying the ``normal equations'' we see that, \GL\ is solving the {\em dual} of the graphical
16: lasso penalized likelihood, by block coordinate ascent; a result which can also be found in \cite{BGA2008}.
17: %different techniques %, we arrive at similar conclusions appearing in \cite{BGA2008}. In this
18: In this dual, the target of estimation is $\B\Sigma$, the covariance matrix,
19: rather than the precision matrix $\B\Theta$. We propose similar
20: primal algorithms \PGL\ and \DPGL, that also operate by block-coordinate descent,
21: where $\B\Theta$ is the optimization target. We study all of these
22: algorithms, and in particular different approaches to solving their
23: coordinate sub-problems. We conclude that \DPGL\ is
24: superior from several points of view.
25: \end{abstract}