ea8a129ea38f9a0e.tex
1: \begin{abstract}
2: Minimax problems, such as 
3: generative adversarial network,
4: adversarial training,
5: and fair training,
6: are widely
7: solved by a multi-step gradient descent ascent (MGDA) method
8: in practice.
9: However, its convergence guarantee is limited.
10: In this paper,
11: inspired by the primal-dual hybrid gradient method,
12: we propose a new semi-anchoring (SA) technique for the MGDA method.
13: This makes the MGDA method 
14: find a stationary point of
15: a structured nonconvex-nonconcave composite minimax problem;
16: its saddle-subdifferential operator satisfies 
17: the weak Minty variational inequality condition.
18: The resulting method, named SA-MGDA, 
19: is built upon a Bregman proximal point method. 
20: %We show that the worst-case rate
21: %of the SA-MGDA method, 
22: %in terms of the Bregman distance between two successive iterates
23: %(and consequently 
24: %the squared gradient norm),
25: %is $O(1/k)$,
26: %where $k$ denotes the number of iterations.
27: %{\cblue We also provide the inexact analysis of the SA-MGDA method.}
28: We further develop its backtracking line-search version,
29: and its non-Euclidean version for smooth adaptable functions.
30: Numerical experiments, including a fair classification training, are provided.
31: \end{abstract}
32: