1: \begin{abstract}

2: Decentralized stochastic gradient algorithms resolve efficiently large-scale finite-sum optimization problems when all agents over networks are reliable. However, these algorithms are not resilient to adverse conditions, such as malfunctioning agents, software bugs, and cyber attacks. This paper aims to handle a class of general composite finite-sum optimization problems over multi-agent cyber-physical systems (CPSs) in the presence of an unknown number of Byzantine agents. Based on the proximal mapping method, variance-reduced (VR) techniques, and a norm-penalized approximation strategy, we propose a decentralized Byzantine-resilient and proximal-gradient algorithmic framework, dubbed \textit{Prox-DBRO-VR}, which achieves an optimization and control goal using only local computations and communications. To reduce asymptotically the variance generated by evaluating the noisy stochastic gradients, we incorporate two localized variance-reduced techniques (\textit{SAGA} and \textit{LSVRG}) into \textit{Prox-DBRO-VR} to design \textit{Prox-DBRO-SAGA} and \textit{Prox-DBRO-LSVRG}. By analyzing the contraction relationships among the gradient-learning error, robust consensus condition, and optimal gap in a unified theoretical framework, it is demonstrated that both \textit{Prox-DBRO-SAGA} and \textit{Prox-DBRO-LSVRG}, with a well-designed constant (resp., decaying) step-size, converge linearly (resp., sub-linearly) inside an error ball around the optimal solution to the optimization problem under standard assumptions. The trade-off between convergence accuracy and the number of Byzantine agents in both linear and sub-linear cases is also characterized. In simulation, the effectiveness and practicability of the proposed algorithms are manifested via resolving a decentralized sparse machine-learning problem over multi-agent CPSs under various Byzantine attacks.

3: \end{abstract}

4: