1: \begin{abstract}                          % Abstract of not more than 200 words.

2: Game theory serves as a powerful tool for distributed optimization in

3: multi-agent systems in different applications. In this paper we consider multi-agent systems that can be modeled by means of potential games whose

4: potential function coincides with a global objective function to be maximized.

5: In this approach, the agents correspond to the strategic decision makers and the optimization problem is equivalent to the problem

6: of learning a \rev3{potential function maximizer} in the designed game. The paper deals with two different information settings in the system. Firstly, we consider systems, where agents have the access to the gradient of their utility functions. However, they do not possess the full information about the joint actions. Thus, to be able to move along the gradient toward a local optimum, they need to exchange the information with their neighbors by means of \emph{communication}. The second setting refers to a \emph{payoff-based} approach to learning potential function maximizers. Here, we assume that at each iteration agents can only observe their own played actions and experienced payoffs. \revi{In both cases, the paper studies unconstrained non-convex optimization with a differentiable objective function.}

7: To develop the corresponding algorithms guaranteeing convergence to a \rev3{local maximum of the potential function} in the game, we utilize the idea of the well-known Robbins-Monro procedure based on the theory of stochastic approximation.

8: \end{abstract}

9: