4d3aaab34714ac94.tex
1: \begin{abstract}
2: Data characterized by high dimensionality and sparsity are commonly used to describe real-world node interactions. Low-rank representation (LR) can map high-dimensional sparse (HDS) data to low-dimensional feature spaces and infer node interactions via modeling data latent associations. Unfortunately, existing optimization algorithms for LR models are computationally inefficient and slowly convergent on large-scale datasets. To address this issue, this paper proposes an \textit{Accelerated Asynchronous Parallel Stochastic Gradient Descent (A$^{2}$PSGD) for High-Dimensional Sparse Data Low-rank Representation} with three fold-ideas: a) establishing a lock-free scheduler to simultaneously respond to scheduling requests from multiple threads; b) introducing a greedy algorithm-based load balancing strategy for balancing the computational load among threads; c) incorporating Nesterov's accelerated gradient into the learning scheme to accelerate model convergence. Empirical studies show that A$^{2}$PSGD outperforms existing optimization algorithms for HDS data LR in both accuracy and training time.
3: \end{abstract}
4: