434fad53502b8201.tex
1: \begin{abstract}
2: \noindent
3: Random projection algorithm is of interest for constrained optimization when the constraint set is not known in advance or the projection operation on the whole constraint set is computationally prohibitive.
4: This paper presents a \textit{distributed random projection} (DRP) algorithm for fully distributed constrained convex optimization problems that can be used by multiple agents connected over a time-varying network,
5: where each agent has its own objective function and its own constrained set.
6: With reasonable assumptions, we prove that the iterates of all agents converge to the same point
7: in the optimal set almost surely.
8: In addition, we consider a variant of the method that uses a mini-batch of
9: consecutive random projections and establish its convergence in almost sure sense.
10: %In addition, when the \an{agents' objective functions are strongly convex},
11: %we also prove that all agents converge to the optimal point in almost sure and mean square sense.
12: Experiments on distributed support vector machines demonstrate fast convergence of the algorithm.
13: It actually shows that the number of iteration required until convergence is much smaller
14: than scanning over all training samples just once.
15: \end{abstract}
16: