1: \begin{abstract}

2:   Dynamic games arise when multiple agents with differing objectives

3:   control a dynamic system.

4:   They model a wide variety of applications in economics,

5:   defense, energy systems and etc.

6:   %

7:   However, compared to single-agent control problems, the

8:   computational methods for dynamic games are relatively limited.

9:   %

10:   As in the single-agent case, only specific dynamic games can

11:   be solved exactly, so approximation algorithms are

12:   required.

13:   %

14:   In this paper, we show how to extend a recursive Newton's algorithm and the popular differential dynamic programming (DDP) for single-agent optimal control to the case of full-information non-zero sum dynamic games.

15:   %

16:   In the single-agent case, the convergence of DDP is proved by comparison with

17:   Newton's method, which converges locally at a quadratic rate.

18:   %

19:   We show that the iterates of Newton's method and DDP are

20:   sufficiently close for the DDP to inherit the quadratic convergence

21:   rate of Newton's method.

22:   %

23:   We also prove both methods result in an open-loop Nash equilibrium and a local feedback $O(\epsilon^2)$-Nash equilibrium.

24:   %

25:   Numerical examples are provided.

26: \end{abstract}

27: