1: \begin{abstract}

2: Consider the problem of minimizing the expected value of a (possibly\emph{

3: nonconvex}) cost function parameterized by a random (vector) variable,

4: when the expectation cannot be computed accurately (e.g., because

5: the statistics of the random variables are unknown and/or the computational

6: complexity is prohibitive). Classical sample stochastic gradient methods

7: for solving this problem may empirically suffer from slow convergence.\textcolor{blue}{{}

8: }In this paper, we propose for the first time a stochastic \emph{parallel}

9: \emph{Successive Convex Approximation}-based\emph{ }(best-response)\emph{

10: }algorithmic framework for general \emph{nonconvex }stochastic sum-utility

11: optimization problems, which arise naturally in the design of multi-agent

12: systems. The proposed novel decomposition enables all users to update

13: their optimization variables \emph{in parallel} by solving a sequence

14: of strongly convex subproblems, one for each user. Almost surely convergence

15: to stationary points is proved. We then customize our algorithmic

16: framework to solve the stochastic sum rate maximization problem over

17: Single-Input-Single-Output (SISO) frequency-selective interference

18: channels, multiple-input-multiple-output (MIMO) interference channels,

19: and MIMO multiple-access channels. Numerical results show that our

20: algorithms are much faster than state-of-the-art stochastic gradient

21: schemes while achieving the same (or better) sum-rates.\end{abstract}

22: