2e4a1f25eb7a9c5b.tex
1: \begin{abstract}
2: \label{sec:abstract}
3: We study decentralized multiagent optimization over networks, modeled as undirected graphs. The optimization problem consists of minimizing a nonconvex smooth function plus a convex extended-value function, which enforces constraints or extra structure on the solution (e.g., sparsity, low-rank). We further assume that the objective function satisfies the Kurdyka-Łojasiewicz (KL) property, with given exponent   $\theta\in [0,1)$. The KL property  is satisfied by several (nonconvex) functions of practical interest, e.g., arising from machine learning applications; in the centralized setting, it permits to achieve strong convergence guarantees. Here we establish  convergence of the same type for  the notorious  decentralized gradient-tracking-based algorithm SONATA, first proposed in\cite{SunDanScu19}. Specifically, \textbf{(i)} when $\theta\in (0,1/2]$,  the sequence generated by SONATA  converges to a stationary solution of the problem at  R-linear rate; \textbf{(ii)} when  $\theta\in (1/2,1)$,  sublinear rate  is certified; and finally \textbf{(iii)}   when $\theta=0$, the iterates will either converge in a finite number of steps or converges at R-linear rate. This matches the convergence behavior of centralized proximal-gradient algorithms except when $\theta=0$. Numerical results validate our theoretical findings. 
4: 
5: {\bf Key words.}
6: distributed optimization, decentralized methods, nonconvex optimization, gradient-tracking, Kurdyka-Łojasiewicz, linear rate. 
7: \end{abstract}
8: