1: \begin{abstract}
2: Minimax problems, such as
3: generative adversarial network,
4: adversarial training,
5: and fair training,
6: are widely
7: solved by a multi-step gradient descent ascent (MGDA) method
8: in practice.
9: However, its convergence guarantee is limited.
10: In this paper,
11: inspired by the primal-dual hybrid gradient method,
12: we propose a new semi-anchoring (SA) technique for the MGDA method.
13: This makes the MGDA method
14: find a stationary point of
15: a structured nonconvex-nonconcave composite minimax problem;
16: its saddle-subdifferential operator satisfies
17: the weak Minty variational inequality condition.
18: The resulting method, named SA-MGDA,
19: is built upon a Bregman proximal point method.
20: %We show that the worst-case rate
21: %of the SA-MGDA method,
22: %in terms of the Bregman distance between two successive iterates
23: %(and consequently
24: %the squared gradient norm),
25: %is $O(1/k)$,
26: %where $k$ denotes the number of iterations.
27: %{\cblue We also provide the inexact analysis of the SA-MGDA method.}
28: We further develop its backtracking line-search version,
29: and its non-Euclidean version for smooth adaptable functions.
30: Numerical experiments, including a fair classification training, are provided.
31: \end{abstract}
32: