5ec2be8c227ad385.tex
1: \begin{abstract}
2:   We consider a distributed convex optimization problem in a network
3: which is time-varying and not always strongly connected. The local
4: cost function of each node is affected by some stochastic process.
5: All nodes of the network collaborate to minimize the average of their
6: local cost functions. The major challenge of our work is that the
7: gradient of cost functions is supposed to be unavailable and has to
8: be estimated only based on the numerical observation of cost functions.
9: Such problem is known as zeroth-order stochastic convex optimization
10: (ZOSCO). In this paper we take a first step towards the distributed
11: optimization problem with a ZOSCO setting. The proposed algorithm
12: contains two basic steps at each iteration: i) each unit updates a
13: local variable according to a random perturbation based single point
14: gradient estimator of its own local cost function; ii) each unit exchange
15: its local variable with its direct neighbors and then perform a weighted
16: average. In the situation where the cost function is smooth and strongly
17: convex, our attainable optimization error is $O(T^{-1/2})$ after
18: $T$ iterations. This result is interesting as $O(T^{-1/2})$ is the
19: optimal convergence rate in the ZOSCO problem. We have also investigate
20: the optimization error with the general Lipschitz convex function,
21: the result is $O(T^{-1/4})$.
22: \end{abstract}
23: