b62c9a5f35b9890a.tex
1: \begin{abstract}
2: 	Decentralized optimization with orthogonality constraints
3: 	is found widely in scientific computing and data science.
4: 	Since the orthogonality constraints are nonconvex,
5: 	it is quite challenging to design efficient algorithms.
6: 	Existing approaches leverage the geometric tools from Riemannian optimization
7: 	to solve this problem at the cost of high sample and communication complexities.
8: 	To relieve this difficulty, 
9: 	based on two novel techniques that can waive the orthogonality constraints,
10: 	we propose a variance-reduced stochastic gradient tracking (VRSGT) algorithm
11: 	with the convergence rate of $O(1 / k)$ to a stationary point.
12: 	To the best of our knowledge, 
13: 	VRSGT is the first algorithm for decentralized optimization with orthogonality constraints
14: 	that reduces both sampling and communication complexities simultaneously.
15: 	In the numerical experiments, 
16: 	VRSGT has a promising performance in a real-world autonomous driving application.
17: 	
18: 	
19: \end{abstract}
20: