78146eb071539097.tex
1: \begin{abstract}
2: When solving consensus optimization problems over a graph, there is 
3: often an explicit characterization of the convergence rate of 
4: Gradient Descent (GD) using the spectrum of the graph Laplacian.
5: The same type of problems under the Alternating Direction Method
6: of Multipliers (ADMM) are, however, poorly understood. 
7: For instance, simple but important non-strongly-convex
8: consensus problems have not yet being analyzed, 
9: especially concerning the dependency
10: of the convergence rate on the graph topology.
11: Recently, for a non-strongly-convex consensus problem, 
12: a connection between distributed ADMM and lifted Markov chains
13: was proposed,
14: followed by a conjecture that ADMM 
15: is faster than GD by a square root factor in its convergence time, 
16: in close analogy to the mixing
17: speedup
18: achieved by lifting several Markov chains. 
19: Nevertheless, a proof of such a claim is is still lacking.
20: Here we provide a full characterization of the convergence of  
21: distributed over-relaxed
22: ADMM for the same type of consensus problem in terms of the topology 
23: of the underlying graph. Our results provide explicit formulas for
24: optimal parameter selection in terms of the second largest eigenvalue
25: of the transition matrix of the graph's random walk.
26: Another consequence of our results is a proof of the 
27: aforementioned conjecture,
28: which interestingly, we show it is valid for any graph, 
29: even the ones whose random walks cannot be 
30: accelerated via Markov chain lifting.
31: \end{abstract}
32: