1: \begin{abstract}

2: Distributed optimization with open collaboration is a popular field since it provides an opportunity for small groups / companies / universities, and individuals to jointly solve huge-scale problems. However, standard optimization algorithms are fragile in such settings due to the possible presence of so-called Byzantine workers -- participants that can send (intentionally or not) incorrect information instead of the one prescribed by the protocol (e.g., send anti-gradient instead of stochastic gradients). Thus, the problem of designing distributed methods with provable robustness to Byzantine workers has been receiving a lot of attention recently. In particular, several works consider a very promising way to achieve Byzantine tolerance via exploiting variance reduction and robust aggregation. The existing approaches use \algname{SAGA}- and \algname{SARAH}-type variance reduced estimators, while another popular estimator -- \algname{SVRG} -- is not studied in the context of Byzantine-robustness. In this work, we close this gap in the literature and propose a new method -- Byzantine-Robust Loopless Stochastic Variance Reduced Gradient (\algname{BR-LSVRG}). We derive non-asymptotic convergence guarantees for the new method in the strongly convex case and compare its performance with existing approaches in numerical experiments.

3: 

4: \keywords{Distributed optimization  \and Byzantine-robustness \and Variance reduction \and Stochastic optimization.}

5: \end{abstract}

6: