1: \begin{abstract}

2: We consider a distributed stochastic optimization problem in networks

3: with finite number of nodes. Each node adjusts its action to optimize

4: the global utility of the network, which is defined as the sum of

5: local utilities of all nodes. Gradient descent method is a common

6: technique to solve the optimization problem, while the computation

7: of the gradient may require much information exchange. In this paper,

8: we consider that each node can only have a noisy numerical observation

9: of its local utility, of which the closed-form expression is not available.

10: This assumption is quite realistic, especially when the system is

11: too complicated or constantly changing. Nodes may exchange the observation

12: of their local utilities to estimate the global utility at each timeslot.

13: We propose stochastic perturbation based distributed algorithms under

14: the assumptions whether each node has collected local utilities of

15: all or only part of the other nodes. We use tools from stochastic

16: approximation to prove that both algorithms converge to the optimum.

17: The convergence rate of the algorithms is also derived. Although the

18: proposed algorithms can be applied to general optimization problems,

19: we perform simulations considering power control in wireless networks

20: and present numerical results to corroborate our claim.

21: \end{abstract}

22: