04fc6656f7fab05a.tex
1: \begin{abstract}
2: The growing amount of high dimensional data in different 
3: machine learning applications requires more efficient and scalable optimization algorithms.
4: In this work, we consider combining two techniques,
5: parallelism and Nesterov's acceleration, 
6: to design faster algorithms for \Lone-regularized loss.
7: We first simplify BOOM \cite{MukherjeeCaFrSi13}, a variant of gradient descent,
8: and study it in a unified framework,
9: which allows us to not only propose a refined measurement of sparsity to improve BOOM,
10: but also show that BOOM is provably slower than FISTA \cite{BeckTe09}.
11: Moving on to parallel coordinate descent methods,
12: we then propose an efficient accelerated version of Shotgun \cite{BradleyKyBiGu11},
13: improving the convergence rate from $O(1/t)$ to $O(1/t^2)$.
14: Our algorithm enjoys a concise form and analysis compared to previous work,
15: and also allows one to study several connected work in a unified way.
16: \end{abstract}
17: