1: \begin{abstract}

2: The dominant line of work in domain adaptation has focused on learning invariant representations using domain-adversarial training.

3: In this paper, we interpret this approach from a \textit{game theoretical perspective}.

4: % 

5: Defining optimal solutions 

6: in domain-adversarial training 

7: as local Nash equilibria, 

8: we show that gradient descent in domain-adversarial training  

9: can violate the asymptotic convergence guarantees of the optimizer, 

10: % 

11: oftentimes hindering the transfer performance.

12: % 

13: % 

14: % 

15: Our analysis leads us to replace gradient descent with

16: high-order 

17: ODE solvers

18: % 

19: (i.e.,~Runge--Kutta), for which we derive asymptotic convergence  guarantees. 

20: This family of optimizers is significantly more stable

21: % 

22: and allows more aggressive learning rates, leading to high performance gains when used as a drop-in replacement over standard optimizers. 

23: %

24: Our experiments show that in conjunction with state-of-the-art domain-adversarial methods, we achieve up to 3.5\% improvement

25: with 

26: % 

27: less than half of training iterations. 

28: % 

29: Our optimizers are 

30: % 

31:  easy to implement, free of additional parameters, and can be  plugged into any domain-adversarial framework.

32: % 

33: \end{abstract}

34: