1: \begin{abstract}

2:  This  paper considers a distributed   stochastic  strongly convex optimization, where  agents  over a network aim to cooperatively minimize the average of  all agents'  local cost functions.

3: %This  paper considers a distributed   stochastic optimization problem, where there {is a group of   agents connected over a network} and  each of them has an expectation-valued  smooth {strongly} convex cost  function. The  agents  want to collaboratively  find an optimal solution that minimizes   the average of all agents'  cost functions.

4: Due to the stochasticity of gradient estimation and distributedness of local objective,

5:   fast linearly convergent distributed algorithms have not been achieved yet.

6: This work proposes a  novel distributed stochastic gradient tracking algorithm with variance reduction,

7: where  the  local gradients are estimated by an increasing batch-size of  {sampled gradients}.

8: With an undirected connected communication graph   and  a geometrically increasing  batch-size,

9:   the {iterates}  are  shown to converge in mean to the optimal solution at a geometric rate (achieving {linear} convergence).

10: The iteration, communication, and oracle complexity for obtaining an  $\epsilon$-optimal solution are established as well.

11: Particulary, the communication complexity is  $\mathcal{O}(\ln (1/\epsilon))$ while

12: the oracle complexity (number of {sampled gradients}) is $\mathcal{O}(1/\epsilon^2)$, {which is of the  same order as that of centralized approaches}.

13:  Hence, the proposed scheme is communication-efficient  { without requiring extra  sampled gradients}.

14: Numerical  simulations  are given to demonstrate the theoretic results.

15: \end{abstract}

16: