c611484803e09b34.tex
1: \begin{abstract}
2: In this paper, we develop two new randomized block-coordinate optimistic gradient algorithms to approximate a solution of nonlinear equations in \revised{large-scale settings}, which are called \textit{root-finding problems}.
3: Our first algorithm is non-accelerated with constant stepsizes, and achieves $\mathcal{O}(1/k)$ best-iterate convergence rate on $\Exp{\norms{Gx^k}^2}$ when the underlying operator $G$ is Lipschitz continuous and satisfies a weak Minty solution condition, where $\Exp{\cdot}$ is the expectation and $k$ is the iteration counter.
4: Our second method is a new accelerated randomized block-coordinate optimistic gradient algorithm.
5: We establish both $\BigO{1/k^2}$ and $\SmallO{1/k^2}$ last-iterate convergence rates on both $\Exp{\norms{Gx^k}^2}$ and $\Exp{\norms{x^{k+1} - x^{k}}^2}$ for this algorithm under the co-coerciveness of $G$.
6: \revised{In addition, we prove that the iterate sequence  $\sets{x^k}$ converges to a solution almost surely, and $\norms{Gx^k}^2$ attains a $\SmallO{1/k}$ almost sure convergence rate.}
7: Then, we apply our methods to a class of \revised{large-scale} finite-sum inclusions, which covers prominent applications in machine learning, statistical learning, and network optimization, especially in federated learning.
8: We obtain two new federated learning-type algorithms \revised{and their convergence rate guarantees for solving this problem class.}
9: 
10: %%%% Keywords.
11: \vspace{1ex}
12: \noindent\textbf{Keywords:}
13: Randomized block-coordinate algorithms;  
14: optimistic gradient method;
15: Nesterov's accelerated method;
16: weak Minty solution;
17: co-coercive equation;
18: finite-sum inclusion.
19: \end{abstract}
20: