72381ad55b5afbc6.tex
1: \begin{abstract}
2:     We consider the problem of decentralized optimization in networks with communication delays.
3:     To accommodate delays, we need decentralized optimization algorithms that work on directed graphs.
4:     Existing approaches require nodes to know their out-degree to achieve convergence.
5:     We propose a novel gossip-based algorithm that circumvents this requirement, allowing decentralized optimization in networks with communication delays.
6:     We prove that our algorithm converges on non-convex objectives, with the same main complexity order term as centralized Stochastic Gradient Descent (SGD), and show that the graph topology and the delays only affect the higher order terms.
7:     We provide numerical simulations that illustrate our theoretical results.
8: \end{abstract}
9: