1: \begin{abstract}

2: We study distributed algorithms for solving global optimization

3: problems in which the objective function is the sum of local

4: objective functions of agents and the constraint set is given by the

5: intersection of local constraint sets of agents. We assume that each

6: agent knows only his own local objective function and constraint

7: set, and exchanges information with the other agents over a randomly

8: varying network topology to update his information state. We assume

9: a {\it state-dependent communication model} over this topology:

10: communication is Markovian with respect to the states of the agents

11: and the probability with which the links are available depends on

12: the states of the agents.

13: 

14: In this paper, we study a {\it projected multi-agent subgradient

15: algorithm} under state-dependent communication. The algorithm

16: involves each agent performing a local averaging to combine his

17: estimate with the other agents' estimates, taking a subgradient step

18: along his local objective function, and projecting the estimates on

19: his local constraint set. The state-dependence of the communication

20: introduces significant challenges and couples the study of

21: information exchange with the analysis of subgradient steps and

22: projection errors. We first show that the multi-agent subgradient

23: algorithm when used with a constant stepsize may result in the agent

24: estimates to diverge with probability one. Under some assumptions on

25: the stepsize sequence, we provide convergence rate bounds on a

26: ``disagreement metric" between the agent estimates. Our bounds are

27: time-nonhomogeneous in the sense that they depend on the initial

28: starting time. Despite this, we show that agent estimates reach an

29: almost sure consensus and converge to the same optimal solution of

30: the global optimization problem with probability one under different

31: assumptions on the local constraint sets and the stepsize sequence.

32: 

33: \end{abstract}

34: