1: \begin{abstract}
2: %
3: The multi-population replicator dynamics (RD) can be considered a
4: dynamic approach to the study of multi-player games, where it was shown
5: to be related to Cross' learning, as well as of systems of coevolving
6: populations.
7: %
8: However, not all of its equilibria are Nash equilibria (NE)
9: of the underlying game, and neither convergence to an NE nor
10: convergence in general are guaranteed.
11: %
12: Although interior equilibria are guaranteed to be NE, no interior
13: equilibrium can be asymptotically stable in the multi-population RD,
14: resulting, e.g., in cyclic orbits around a single interior NE.
15: %
16: %
17: We introduce a new notion of equilibria of RD, called mutation limits,
18: which is based on the inclusion of a naturally arising, simple form of
19: mutation, but is invariant under the specific choice of mutation
20: parameters.
21: %
22: We prove the existence of such mutation limits for a large range of
23: games, and consider a subclass of particular interest, that of
24: attracting mutation limits.
25: %
26: Attracting mutation limits are approximated by asymptotically stable
27: equilibria of the (mutation-)perturbed RD, and hence, offer an
28: approximate dynamic solution of the underlying game, especially if the
29: original dynamic has no asymptotically stable equilibria.
30: %
31: In this sense, mutation stabilises the system in certain cases and
32: makes attracting mutation limits near-attainable.
33: %
34: %
35: Furthermore, the relevance of attracting mutation limits as a game
36: theoretic equilibrium concept is emphasised by a similarity of
37: (mutation-)perturbed RD to the Q-learning algorithm in the context of
38: multi-agent reinforcement learning.
39: %
40: In contrast to the guaranteed existence of mutation limits,
41: attracting mutation limits do not exist in all games, raising the
42: question of their characterization.
43: \end{abstract}
44: