1: \begin{abstract}

2: We introduce the paradigm of \emph{validated decentralized learning} for undirected networks with heterogeneous data and possible adversarial infiltration.  We require \emph{(a)} convergence to a global empirical loss minimizer when adversaries are absent, and \emph{(b)} either detection of adversarial presence or convergence to an admissible consensus model in their presence. This contrasts sharply with the traditional byzantine-robustness requirement of convergence to an admissible consensus irrespective of the adversarial configuration. To this end, we propose the \protocol protocol which, to the best of our knowledge, is the first to achieve a validated learning guarantee. Moreover, \protocol offers an $O(1/T)$ convergence rate (under pertinent regularity assumptions), and computational and communication complexities comparable to non-adversarial distributed stochastic gradient descent. Remarkably, \protocol  retains optimal performance metrics in adversary-free environments, sidestepping the robustness penalties observed in prior byzantine-robust methods. {A distinctive aspect of our study is a heterogeneity metric based on the norms of individual agents' gradients  computed at the global empirical loss minimizer. This not only provides a natural statistic for detecting significant byzantine disruptions but also allows us to prove the optimality of \protocol in wide generality.  

3:  Lastly, our numerical results reveal that,  in the absence of  adversaries, \protocol converges faster than state-of-the-art byzantine robust algorithms, while when adversaries are present, \protocol terminates with each honest agent either converging to  an admissible consensus or declaring adversarial presence in the network.}

4: \end{abstract}

5: