1: $ (by~\cref{thm: SGDA for FERMI convergence rate}). Recall that for $