30ede3fba10052e0.tex
1: \begin{abstract}
2: \vspace{-2mm}
3: We describe \ASAGA, an asynchronous parallel version of the incremental gradient algorithm \SAGA\ that enjoys fast linear convergence rates. 
4: Through a novel perspective, we revisit and clarify a subtle but important technical issue present in a large fraction of the recent convergence rate proofs for asynchronous parallel optimization algorithms, and propose a simplification of the recently introduced ``perturbed iterate'' framework that resolves it. 
5: We thereby prove that \ASAGA\ can obtain a theoretical linear speedup on multi-core systems even without sparsity assumptions. 
6: We present results of an implementation on a 40-core architecture illustrating the practical speedup as well as the hardware overhead. 
7: \end{abstract}