1: \begin{abstract}

2: Motivated by problems arising in decentralized control problems and

3: non-cooperative Nash games, we consider a class of strongly monotone

4: Cartesian variational inequality (VI) problems, where the mappings either contain

5: expectations or their evaluations are corrupted by error. Such

6: complications are captured under the umbrella of Cartesian stochastic variational

7: inequality problems and we consider \an{solving} such

8: problems via stochastic approximation {(SA)} schemes. Specifically, we propose

9: a scheme wherein the

10: steplength sequence is derived by a rule that depends on problem

11: parameters such as monotonicity and Lipschitz constants. The proposed

12: scheme is seen to produce sequences that are guaranteed to converge

13: almost surely to the unique solution of the problem. To cope with

14: networked multi-agent generalizations, we provide requirements under

15: which independently chosen steplength rules still possess

16: desirable almost-sure convergence properties. In the second part

17: of this paper, we consider a regime where Lipschitz constants on the map

18: are either unavailable or difficult to derive. Here, we present a local

19: randomization technique that allows for deriving an approximation of

20: the original mapping, {which is then shown} to be Lipschitz continuous

21: with a prescribed constant. Using this technique, we introduce a

22: locally randomized SA {algorithm} and provide almost sure convergence

23: theory for the resulting sequence of iterates to an approximate solution

24: of the original variational inequality problem. Finally, the paper

25: concludes with some preliminary numerical results on a stochastic rate

26: allocation problem and a stochastic Nash-Cournot game.

27: 	\end{abstract}