1: \begin{abstract}
2: The graphical lasso \citep{BGA2008,FHT2007a} is a popular approach
3: for learning the structure in an undirected Gaussian graphical
4: model, using $\ell_1$ regularization to control the number of zeros
5: in the precision matrix ${\B\Theta}={\B\Sigma}^{-1}$. The R
6: package \GL\ is popular, fast, and allows one to efficiently build a
7: path of models for different values of the tuning parameter.
8: Convergence of \GL\ can be tricky; the converged precision matrix
9: might not be the inverse of the estimated covariance, and
10: occasionally it fails to converge with warm starts. In this paper we
11: explain this behavior, and propose new algorithms that appear to
12: outperform \GL.
13:
14: We show that in fact \GL\ is solving the {\em dual} of the graphical
15: lasso penalized likelihood, by block coordinate descent. In this
16: dual, the target of estimation is $\B\Sigma$, the covariance matrix,
17: rather than the precision matrix $\B\Theta$. We propose similar
18: primal algorithms \PGL\ and \DPGL, that also operate by block-coordinate descent,
19: where $\B\Theta$ is the optimization target. We study all of these
20: algorithms, and in particular different approaches to solving their
21: coordinate subproblems. We conclude that \DPGL\ is
22: superior from several points of view.
23: \end{abstract}