c8519e3f9f29e283.tex
1: \begin{abstract}
2: 		Vertical federated learning (VFL) is an effective paradigm of training the emerging cross-organizational (\emph{e.g.}, different corporations, companies and organizations) collaborative learning with privacy preserving.
3: 		% and thus has attracted much interest from the machine learning community.
4: 		Stochastic gradient descent (SGD) methods are the popular choices for training VFL models because of the low per-iteration computation.
5: 		However, existing SGD-based VFL algorithms are communication-expensive due to a large number of communication rounds.
6: 		Meanwhile, most existing VFL algorithms use synchronous computation which seriously hamper the computation resource utilization  in real-world applications. To address the challenges of communication and computation resource utilization, we propose an asynchronous stochastic quasi-Newton (AsySQN) framework for VFL, under which three algorithms, {\ie} AsySQN-SGD, -SVRG and -SAGA, are proposed. The proposed AsySQN-type algorithms making descent steps scaled by approximate (without calculating the inverse Hessian matrix explicitly) Hessian information convergence much faster than SGD-based methods in practice and thus can dramatically reduce the number of communication rounds. Moreover, the adopted asynchronous computation can make better use of the computation resource.
7: 		We theoretically prove the convergence rates of our proposed algorithms for strongly convex problems. Extensive numerical experiments on real-word datasets demonstrate the lower communication costs and  better computation resource utilization of our algorithms compared with state-of-the-art VFL algorithms.
8: 	\end{abstract}
9: