c6b7ff2f27b22f8e.tex
1: \begin{abstract}%   <- trailing '%' for backward compatibility of .sty file
2: In this paper, we consider first-order convergence theory and algorithms for solving a class of non-convex non-concave min-max saddle-point problems, whose objective function is weakly convex in the variables of minimization and weakly concave in the variables of maximization. 
3: It  has many important applications in machine learning including training Generative Adversarial Nets (GANs). We propose an algorithmic framework  motivated by the inexact proximal point method, where the weakly monotone variational inequality (VI) corresponding to the original min-max problem is solved through approximately solving a sequence of strongly monotone VIs constructed by adding a strongly monotone mapping to the original gradient mapping. 
4: We prove first-order convergence to  a nearly stationary  solution of the original min-max problem of the generic algorithmic framework and establish different rates by employing different algorithms for solving each strongly monotone VI. 
5: %Our algorithm generates a sequence of solutions that provably converges to a nearly stationary  solution of the original min-max problem. 
6: %Our algorithm has different complexities when the strongly monotone VIs are solved by different methods under different assumptions, including subgradient method, stochastic subgradient method for a bounded mapping,  gradient descent method, extragradient method, Nesterov's accelerated method and variance-reduction methods for a Lipschitz continuous operator.  
7: Experiments verify the convergence theory and also demonstrate the effectiveness of the proposed methods on training GANs. 
8: \end{abstract}
9: