1: \begin{abstract}

2: In this paper we first present a novel operator extrapolation (OE) method

3: for solving deterministic variational inequality (VI) problems. Similar to the gradient (operator) projection method,

4: OE updates one single search sequence by solving a single projection subproblem in each iteration.

5: We show that OE can achieve the optimal rate of convergence for solving a variety of

6: VI problems in a much simpler way than existing approaches.

7: We then introduce the stochastic operator extrapolation (SOE) method and establish 

8: its optimal convergence behavior for solving different stochastic VI problems.

9: In particular, SOE achieves the optimal complexity for solving a fundamental problem, i.e., stochastic smooth and strongly

10: monotone VI, for the first time in the literature. We also present

11: a stochastic block operator extrapolations (SBOE) method to further reduce the iteration cost for the OE method applied to large-scale

12: deterministic VIs with a certain block structure.

13: Numerical experiments

14: have been conducted to demonstrate the potential advantages of the proposed algorithms.

15: In fact, all these algorithms are applied to solve generalized monotone variational inequality (GMVI) problems

16: whose operator is not necessarily monotone.

17: We will also discuss optimal OE-based policy evaluation methods for reinforcement learning in a companion paper.\\

18: 

19: \noindent {\bf Keywords:} Variational inequality, operator extrapolation, acceleration, stochastic policy evaluation.\\

20: {\bf Mathematics Subject Classification (2000):} 90C25, 90C15, 62L20, 68Q25.

21:  \end{abstract}

22: