1: \begin{abstract}
2: We propose a communication and computation efficient second-order method for distributed optimization.
3: For each iteration, our method only requires $\mathcal{O}(d)$ communication complexity, where $d$ is the problem dimension.
4: We also provide theoretical analysis to show the proposed method has the similar convergence rate as the classical second-order optimization algorithms.
5: Concretely, our method can find~$\big(\epsilon, \sqrt{dL\epsilon}\,\big)$-second-order stationary points for nonconvex problem by $\mathcal{O}\big(\sqrt{dL}\,\epsilon^{-3/2}\big)$ iterations, where $L$ is the Lipschitz constant of Hessian. Moreover, it enjoys a local superlinear convergence under the strongly-convex assumption.
6: Experiments on both convex and nonconvex problems show that our proposed method performs significantly better than baselines.
7: \end{abstract}
8: