87b3f2c949febbc1.tex
1: \begin{abstract}
2:   Nonconvex and structured optimization problems arise in many engineering applications that demand scalable and distributed solution methods.
3:  The study of the convergence properties of these methods is in general difficult due to the nonconvexity of the problem.
4: % This paper investigates convergence properties of scalable/distributed algorithms for \emph{nonconvex} and structured optimization. 
5:  In this paper, two distributed solution methods that combine the fast convergence properties of augmented Lagrangian-based methods with the separability properties of  alternating optimization are investigated. 
6:  The first method is adapted from the classic quadratic penalty function method and is called the \emph{Alternating Direction Penalty Method} (ADPM). 
7:  Unlike the original quadratic penalty function method, in which single-step optimizations are adopted, ADPM uses an alternating optimization, which in turn makes it scalable. 
8:  The second method is the well-known \emph{Alternating Direction Method of Multipliers} (ADMM). 
9:  It is shown that ADPM for nonconvex problems asymptotically converges to a primal feasible point under mild conditions \BlueText{and an additional condition ensuring that it asymptotically reaches the standard first order necessary conditions for local optimality are introduced. }
10: % Moreover, we give numerical evidence to demonstrate the potentials of the ADPM for computing a good objective value. 
11:  In the case of the ADMM, novel sufficient conditions under which the algorithm asymptotically reaches the standard first order necessary conditions are established.  
12:  \BlueText{ Based on this, complete convergence of ADMM for a class of low dimensional problems are characterized. }
13:  %Throughout the paper, we substantiate the theory with numerical examples and 
14:  Finally, the results are illustrated by applying ADPM and ADMM to a nonconvex localization problem in wireless sensor~networks. 
15: \end{abstract}
16: