1: \begin{abstract}

2: We present a new approach to solving games with a countably or uncountably infinite number of players.

3: Such games are often used to model multiagent systems with a large number of agents.

4: The latter are frequently encountered in economics, financial markets, crowd dynamics, congestion analysis, epidemiology, and population ecology, among other fields.

5: Our two primary contributions are as follows.

6: First, we present a way to represent strategy profiles for an infinite number of players, which we name a \emph{Player-to-Strategy Network (P2SN)}.

7: Such a network maps players to strategies, and exploits the generalization capabilities of neural networks to learn across an infinite number of inputs (players) simultaneously.

8: Second, we present an algorithm, which we name \emph{Shared-Parameter Simultaneous Gradient (SPSG)}, for training such a network, with the goal of finding an approximate Nash equilibrium.

9: This algorithm generalizes simultaneous gradient ascent and its variants, which are classical equilibrium-seeking dynamics used for multiagent reinforcement learning.

10: We test our approach on infinite-player games and observe its convergence to approximate Nash equilibria.

11: Our method can handle games with infinitely many states, infinitely many players, infinitely many actions (and mixed strategies on them), and discontinuous utility functions.

12: \end{abstract}

13: