1: \begin{abstract}

2: Decentralized optimization is gaining increased traction due to its widespread applications in large-scale machine learning and multi-agent systems. The same mechanism that enables its success, i.e., information sharing among participating agents, however, also leads to the

3: disclosure of individual agents' private information, which is unacceptable when  sensitive data are involved.

4: As differential privacy is becoming a de facto standard for privacy preservation, recently  results have emerged integrating differential privacy with distributed optimization.

5: However, directly incorporating differential privacy design in existing distributed optimization approaches   significantly compromises  optimization accuracy. In this paper, we propose to redesign and tailor  gradient methods for differentially-private distributed optimization, and propose two differential-privacy oriented gradient methods that can ensure both {rigorous $\epsilon$-differential privacy} and optimality.

6: %

7: %We prove that the proposed distributed algorithms can ensure almost sure

8: %convergence to an optimal solution under any persistent and variance-bounded differential-privacy noise, which, to the best of our knowledge, has not been reported before.

9: The first algorithm is based on static-consensus based gradient methods, and the second algorithm is based on dynamic-consensus (gradient-tracking) based distributed optimization methods and, hence,  is applicable to general directed interaction  graph  topologies.

10: {Both  algorithms can  simultaneously ensure   almost sure convergence  to an optimal solution and a finite privacy budget, even when the number of iterations goes to infinity. To our knowledge, this is the first time that  both goals are achieved simultaneously.}   Numerical {simulations using a distributed estimation problem and experimental results on a benchmark dataset} confirm  the effectiveness of the proposed approaches.

11: \end{abstract}

12: