6d2c5f38ea398b86.tex
1: \begin{abstract}
2:  The  paper considers    distributed  stochastic optimization  over randomly switching networks, where agents collaboratively minimize   the average of all agents' local  expectation-valued convex cost  functions. Due to the stochasticity in gradient observations, distributedness of local functions, and randomness of  communication topologies,
3:  distributed algorithms with a convergence guarantee under fixed step-sizes have not been achieved yet.
4: This work   incorporates variance reduction  scheme  into the distributed stochastic gradient tracking algorithm, where    local gradients are estimated by averaging  across a variable   number of  sampled gradients.
5: With an identically and independently distributed (i.i.d.) random network,
6: we   show that all agents' iterates  converge almost surely to the same optimal solution under fixed step-sizes. When the global  cost function is strongly convex and the sample size increases at a geometric rate, we  prove that the  iterates geometrically   converge   to the unique optimal solution, and establish the iteration, oracle, and  communication  complexity. The algorithm performance including rate and complexity analysis   are further  investigated with  constant step-sizes and  a polynomially increasing sample size. Finally, the empirical algorithm  performance  are illustrated with
7: numerical examples.
8: \end{abstract}
9: