1: \begin{abstract}

2: %Convexity has become a standard assumption to establish the convergence of

3: %stochastic approximation (SA) type algorithms in the literature.

4: In this paper, we introduce a new stochastic approximation (SA) type algorithm, namely

5: the randomized stochastic gradient (RSG) method, for solving an important class of

6: nonlinear (possibly nonconvex) stochastic programming (SP) problems.

7: We establish the complexity of this method for computing an approximate stationary point

8: of a nonlinear programming problem. We also show that this method possesses

9: a nearly optimal rate of convergence if the problem is convex. We discuss a variant of the algorithm

10: which consists of applying a post-optimization phase to evaluate a short list of solutions

11: generated by several independent runs of the RSG method, and show that such modification allows to improve significantly

12: the large-deviation properties of the algorithm.

13: These methods are then specialized for solving a class of simulation-based

14: optimization problems in which only stochastic zeroth-order information is available.

15: %We also develop a special version  of the method for solving a class

16: %of simulation-based optimization problems in which only stochastic zero-order information is available.

17: 

18: \vspace{.1in}

19: 

20: \noindent {\bf Keywords:} stochastic approximation, nonconvex optimization, stochastic programming, simulation-based optimization

21: 

22: \end{abstract}