f32785280c4ab401.tex
1: \begin{abstract}
2: Recently, many cooperative distributed multi-agent reinforcement learning (MARL) algorithms have been proposed in the literature. In this work, we study the effect of adversarial attacks on a network that employs a consensus-based MARL algorithm. We show that an adversarial agent can persuade all the other agents in the network to implement policies that optimize an objective that it desires. In this sense, the standard consensus-based MARL algorithms are fragile to attacks. %Under standard assumptions, we prove the asymptotic convergence to a policy that locally maximizes the adversary's objective.
3: %Consensus algorithms are suitable for training agents in cooperative distributed multi-agent reinforcement learning (MARL) since they ensure full privacy of the agents' individual rewards. However, the privacy guarantee is traded off with a higher requirement for communication between the agents and their reliability. In this work, we study the effect of adversarial attacks on a network that employs a general consensus MARL algorithm. We show that an adversarial agent can persuade all other agents in the network to achieve a compromised objective. Under standard assumptions, we prove the asymptotic convergence to a policy that locally maximizes the adversary's objective.
4: \end{abstract}
5: