1: \begin{abstract}

2:   In this paper, we analyze the convergence of a distributed

3:   Robbins-Monro algorithm for both constrained and unconstrained

4:   optimization in multi-agent systems.  The algorithm searches for local

5:   minima of a (nonconvex) objective function which is supposed to

6:   coincide with a sum of local utility functions of the agents.  The

7:   algorithm under study consists of two steps: a local stochastic

8:   gradient descent at each agent and a gossip step that drives the

9:   network of agents to a consensus.  It is proved that {\sl i)} an

10:   agreement is achieved between agents on the value of the estimate,

11:   {\sl ii)} the algorithm converges to the set of Kuhn-Tucker points

12:   of the optimization problem.  The proof relies on recent results

13:   about differential inclusions. In the context of unconstrained

14:   optimization, intelligible sufficient conditions are provided in

15:   order to ensure the stability of the algorithm.  In the latter case,

16:   we also provide a central limit theorem which governs the asymptotic

17:   fluctuations of the estimate.

18:   We illustrate our results in the case of distributed power allocation

19:   for ad-hoc wireless networks.

20: 

21: %Under verifiable sufficient conditions, we give an

22: % explicit rate of convergence for this algorithm and provide a conditional

23: % Central Limit Theorem.  Our results are applied to distributed source

24: % localization.

25: 

26: \end{abstract}