1: \begin{abstract}

2: % We present an enhancement to  the recently proposed random directions stochastic approximation (RDSA) algorithm \cite{prashanth2017rdsa}. 

3: % We incorporate a deterministic scheme for choosing perturbation in both first-order 1RDSA and second-order 2RDSA algorithms. We show that the gradient and/or Hessian estimates in the resulting 1RDSA/2RDSA algorithms with deterministic perturbations are asymptotically unbiased, and hence the overall 1RDSA-DP/2RDSA-DP algorithms converge in an asymptotic sense. Further, for the special case of a quadratic optimization problem, we derive convergence rates to establish the superiority of 1RDSA-DP/2RDSA-DP over regular 1RDSA/2RDSA.

4: % Numerical experiments are used to validate the theoretical results.

5: We introduce deterministic perturbation schemes for the recently proposed random directions stochastic approximation (RDSA) \cite{prashanth2017rdsa},

6: and propose new first-order and second-order algorithms. 

7: In the latter case, these are the first second-order algorithms to incorporate deterministic perturbations. 

8: We show that the gradient and/or Hessian estimates in the resulting algorithms with deterministic perturbations are asymptotically unbiased, so that the algorithms are provably convergent. 

9: Furthermore, we derive convergence rates to establish the superiority

10: of the first-order and second-order algorithms, for the special case of a convex and quadratic optimization problem, respectively. 

11: Numerical experiments are used to validate the theoretical results.

12: \end{abstract}

13: