1: \begin{abstract}

2: % We aim to study finite player stochastic games with heterogeneous interaction among agents. The finite player game is challenging to solve due to curse of dimensionality.  

3: % Thus, we propose a discrete-time graphon game formulation on continuous state and action spaces using a representative player. 

4: % This formulation admits both conceptual and mathematical advantages, compared to the widely adopted graphon game formulation using a continuum of players. %, which suffers from major measurability issue. 

5: % We prove the existence and uniqueness of the graphon equilibrium with mild assumptions, and show that this graphon equilibrium is an approximate solution for the original finite player game. An online oracle-free learning algorithm is developed to solve the equilibrium numerically, and provide sample complexity analysis for its convergence.

6: We propose a discrete-time graphon game formulation on continuous state and action spaces using a representative player to study stochastic games with heterogeneous interaction among agents. 

7: This formulation admits both philosophical and mathematical advantages, compared to a widely adopted formulation using a continuum of players. 

8: We prove the existence and uniqueness of the graphon equilibrium with mild assumptions, and show that this equilibrium can be used to construct an approximate solution for finite player game on networks, which is challenging to analyze and solve due to curse of dimensionality. An online oracle-free learning algorithm is developed to solve the equilibrium numerically, and sample complexity analysis is provided for its convergence.

9: \end{abstract}

10: