1: \begin{abstract}  

2:     Matrix-stepsized gradient descent algorithms have been shown to have superior performance in non-convex optimization problems compared to their scalar counterparts. 

3:     The \texttt{det-CGD} algorithm, as introduced by \citet{li2023det}, leverages matrix stepsizes to perform compressed gradient descent for non-convex objectives and matrix-smooth problems in a federated manner. 

4:     The authors establish the algorithm's convergence to a neighborhood of a weighted stationarity point under a convex condition for the symmetric and positive-definite matrix stepsize. 

5:     In this paper, we propose two variance-reduced versions of the \texttt{det-CGD} algorithm, incorporating {\marina} and {\dasha} methods. 

6:     Notably, we establish theoretically and empirically, that {\detmarina} and {\detdasha} outperform {\marina}, {\dasha} and the distributed {{\detcgd}} algorithms in terms of iteration and communication complexities. 

7: \end{abstract}

8: