1: \begin{abstract}

2: The \textit{ex ante} equilibrium for two-team zero-sum games, where agents within each team collaborate to compete against the opposing team, is known to be the best a team can do for coordination. Many existing works on \textit{ex ante} equilibrium solutions are aiming to extend the scope of \textit{ex ante} equilibrium solving to large-scale team games based on Policy Space Response Oracle (PSRO). However, the joint team policy space constructed by the most prominent method, Team PSRO, cannot cover the entire team policy space in \textit{heterogeneous} team games where teammates play distinct roles. Such insufficient policy expressiveness causes Team PSRO to be trapped into a sub-optimal \textit{ex ante} equilibrium with significantly higher exploitability and never converges to the global \textit{ex ante} equilibrium. To find the global \textit{ex ante} equilibrium without introducing additional computational complexity, we first parameterize heterogeneous policies for teammates, and we prove that optimizing the heterogeneous teammates' policies sequentially can guarantee a monotonic improvement in team rewards. 

3: We further propose \textbf{Heterogeneous-PSRO} (\textbf{H-PSRO}), a novel framework for \textit{heterogeneous} team games, which integrates the sequential correlation mechanism into the PSRO framework and serves as the first PSRO  framework for \textit{heterogeneous} team games. 

4: We prove that H-PSRO achieves lower exploitability than Team PSRO in \textit{heterogeneous} team games. 

5: Empirically, H-PSRO achieves convergence in matrix heterogeneous games that are unsolvable by non-heterogeneous baselines. 

6: Further experiments reveal that H-PSRO outperforms non-heterogeneous baselines in both heterogeneous team games and homogeneous settings.

7: 

8: 

9: 

10: \end{abstract}

11: