1: \begin{abstract}

2: We present new algorithms for \textit{simulation optimization} using random directions stochastic approximation (RDSA). 

3: These include first-order (gradient) as well as second-order (Newton) schemes.

4: We incorporate both continuous-valued as well as discrete-valued perturbations into both our algorithms. The former are chosen to be independent and identically distributed (i.i.d.) symmetric uniformly distributed random variables (r.v.), while the latter are i.i.d., asymmetric Bernoulli r.v.s.

5: Our Newton algorithm, with a novel Hessian estimation scheme, requires $N$-dimensional perturbations and three loss measurements per iteration, whereas the simultaneous perturbation Newton search algorithm of \cite{spall_adaptive} requires $2N$-dimensional perturbations and four loss measurements per iteration. 

6: We prove the unbiasedness of both gradient and Hessian estimates and asymptotic (strong) convergence for both first-order and second-order schemes. We also provide asymptotic normality results, which in particular establish that 

7: the asymmetric Bernoulli variant of Newton RDSA method is better than 2SPSA of \cite{spall_adaptive}. 

8: Numerical experiments are used to validate the theoretical results.

9: % In particular, our experiments show that our Newton algorithm 2RDSA and the Newton algorithm 2SPSA in \cite{spall_adaptive} provide comparable accuracy levels in the same number of iterations, despite 2RDSA requiring only 75\% of the cost per-iteration for 2SPSA.

10: \end{abstract}

11: