1: \begin{abstract}

2: %Improving the sample efficiency in multi-agent reinforcement learning (MARL) is more challenging than in single-agent reinforcement learning because of agents' interactions. 

3: % w.r.t. the policy distribution shift, the generalization errors of the dynamics model and opponent models. 

4: %\xihuai{A possibly ambiguous point: The bounds have nothing to do with the sample complexity, they only focus on the methods' effectiveness. We make a trade-off between reducing the generalization errors of opponent models in the upper bounds and the opponent sample complexity.}

5: %With a sufficiently low upper bound, the model-based techniques leads to a low sample complexity during the whole learning process, 

6: This paper investigates the model-based methods in multi-agent reinforcement learning (MARL). We specify the dynamics sample complexity and the opponent sample complexity in MARL, and conduct a theoretic analysis of return discrepancy upper bound. To reduce the upper bound with the intention of low sample complexity during the whole learning process, we propose a novel decentralized model-based MARL method, named Adaptive Opponent-wise Rollout Policy Optimization (AORPO). In AORPO, each agent builds its multi-agent environment model, consisting of a dynamics model and multiple opponent models, and trains its policy with the adaptive opponent-wise rollout. We further prove the theoretic convergence of AORPO under reasonable assumptions. Empirical experiments on competitive and cooperative tasks demonstrate that AORPO can achieve improved sample efficiency with comparable asymptotic performance over the compared MARL methods.

7: \end{abstract}

8: