1: \begin{abstract}

2: Learning when to communicate and doing that effectively is essential in multi-agent tasks. 

3: Recent works show that continuous communication allows efficient training with back-propagation in multiagent scenarios, but have been restricted to fully-cooperative tasks.

4: In this paper, we present \modelName{} (\modelShort{}) which has better training efficiency than simple continuous communication model, and can be applied to semi-cooperative and competitive settings along with the cooperative settings. IC3Net controls continuous communication with a gating mechanism and uses individualized rewards for each agent to gain better performance and scalability while fixing credit assignment issues. 

5: Using variety of tasks including StarCraft BroodWars\texttrademark{} explore and combat scenarios, we show that our network yields improved performance and convergence rates than the baselines as the scale increases. Our results convey that IC3Net agents learn when to communicate based on the scenario and profitability.  

6: 

7: % Several multi-agents tasks in AI are not fully-cooperative in nature requiring each agent to achieve individual goals where it can either collaborate with other agents to optimize global reward or compete with them for better individual reward. In most of the real-life tasks, humans have availability of communication, but they learn when to communicate to optimize their own reward and team's reward as a whole. To instill similar choice of communication in our agents and optimize rewards regardless of the cooperation setting, in this paper, we present an architecture which is model agnostic and can be used in cooperative, semi-cooperative and competitive settings to learn when to communicate. We test our architecture on variety of tasks including StarCraft BroodWars micro-management scenarios, to show that our architecture yields improved performance and convergence rates in all of the scenarios than the baselines.  

8: \end{abstract}

9: