b15e4f1b83b60a06.tex
1: \begin{abstract}                          % Abstract of not more than 200 words.
2: Privacy protection  and nonconvexity are two challenging problems in
3: decentralized optimization and learning involving sensitive data.
4: Despite some recent advances  addressing each of the two problems
5: separately, no results have been reported that  have theoretical
6: guarantees on both privacy protection and saddle/maximum avoidance
7: in decentralized nonconvex optimization. We propose a new algorithm
8: for decentralized nonconvex optimization that can enable both
9: rigorous differential privacy and   saddle/maximum avoiding
10: performance. The new algorithm allows the incorporation of
11: persistent additive noise to enable rigorous differential privacy
12: for  data samples, gradients, and intermediate optimization
13: variables without losing provable convergence, and thus
14: circumventing the dilemma of trading accuracy for privacy in
15: differential privacy design. More interestingly, the
16:  algorithm is  theoretically proven to be able to  efficiently { guarantee accuracy by avoiding}  convergence to local
17: maxima and saddle points, which has not been reported before in the
18: literature on decentralized nonconvex optimization. The algorithm is
19: efficient in both communication (it only shares one variable in each
20: iteration) and computation (it is encryption-free), and hence is
21: promising for large-scale nonconvex optimization and learning
22:  involving high-dimensional optimization parameters. Numerical experiments
23:  for
24: both a decentralized estimation problem and an Independent Component
25: Analysis (ICA) problem
26:  confirm the effectiveness of the proposed approach.
27: \end{abstract}