ef52af4b792a57a3.tex
1: \begin{abstract}
2: Network consensus optimization has received increasing attention in recent years and has found important applications in many scientific and engineering fields.
3: To solve network consensus optimization problems, one of the most well-known approaches is the distributed gradient descent method (DGD).
4: However, in networks with slow communication rates, DGD's performance is unsatisfactory for solving high-dimensional network consensus problems due to the communication bottleneck.
5: This motivates us to design a communication-efficient DGD-type algorithm based on compressed information exchanges.
6: Our contributions in this paper are three-fold:
7: i) We develop a communication-efficient algorithm called amplified-differential compression DGD (ADC-DGD) and show that it converges under {\em any} unbiased compression operator;
8: ii) We rigorously prove the convergence performances of ADC-DGD and show that they match with those of DGD without compression;
9: iii) We reveal an interesting phase transition phenomenon in the convergence speed of ADC-DGD.
10: Collectively, our findings advance the state-of-the-art of network consensus optimization theory.
11: \end{abstract}
12: