54fcbd97ed62886e.tex
1: \begin{abstract}
2: 
3: 
4: This paper studies the distributed optimization problem over directed networks with noisy  information-sharing. To resolve the imperfect communication  issue over directed networks, a series of  noise-robust variants  of Push-Pull/AB method have been developed. These methods improve the robustness of Push-Pull method against the information-sharing noise through adding small factors on weight matrices and replacing  the global gradient tracking with the cumulative gradient tracking. 
5: %However, the two techniques ensure the almost sure convergence to optimum under more strong assumptions than conventional Push-Pull method. 
6: Based on the two techniques, we propose a new variant of the Push-Pull method  by presenting a novel mechanism of inter-agent information aggregation, named variance-reduced aggregation (VRA). VRA helps us to release some conditions on the objective function and networks. When the objective function is convex  and the sharing-information noise is variance-unbounded, it can be shown that the proposed method converges to the optimal solution almost surely. When the objective function is strongly convex  and the sharing-information noise is variance-bounded,  the proposed method achieves the convergence rate of {\footnotesize$\mathcal{O}\left(k^{-(1-\epsilon)}\right)$} in the mean square sense, where $\epsilon$ could be close to 0 infinitely. Simulated experiments on ridge regression problems verify the effectiveness of the proposed method.
7: 
8: 
9: 
10: \end{abstract}