1: \begin{abstract}

2: We develop a unified theory of augmented Lagrangians for nonconvex optimization problems that encompasses both duality

3: theory and convergence analysis of primal-dual augmented Lagrangian methods in the infinite dimensional setting. Our

4: goal is to present many well-known concepts and results related to augmented Lagrangians in a unified manner and bridge

5: a gap between existing convergence analysis of primal-dual augmented Lagrangian methods and abstract duality theory.

6: Within our theory we specifically emphasize the role of various fundamental duality concepts (such as duality gap,

7: optimal dual solutions, global saddle points, etc.) in convergence analysis of augmented Lagrangians methods and 

8: underline interconnections between all these concepts and convergence of primal and dual sequences generated by such

9: methods. In particular, we prove that the zero duality gap property is a necessary condition for the boundedness of the

10: primal sequence, while the existence of an optimal dual solution is a necessary condition for the boundedness of the

11: sequences of multipliers and penalty parameters, irrespective of the way in which the multipliers and the penalty

12: parameter are updated. Our theoretical results are applicable to many different augmented Lagrangians for various types

13: of cone constrained optimization problems, including Rockafellar-Wets' augmented Lagrangian, (penalized)

14: exponential/hyperbolic-type augmented Lagrangians, modified barrier functions, etc.

15: \end{abstract}

16: