1: \begin{abstract}

2: In this study, we consider the infinite-horizon, discounted cost, optimal control of stochastic nonlinear systems with separable cost and constraints in the state and input variables. 

3: Using the linear-time Legendre transform, we propose a novel numerical scheme for implementation of the corresponding value iteration (VI) algorithm in the conjugate domain. 

4: Detailed analyses of the convergence, time complexity, and error of the proposed algorithm are provided. 

5: In particular, with a discretization of size $X$ and $U$ for the state and input spaces, respectively, the proposed approach reduces the time complexity of each iteration in the VI algorithm from $\ord(XU)$ to $\ord (X+U)$, by replacing the minimization operation in the primal domain with a simple addition in the conjugate domain. 

6: 

7: \smallskip

8: \noindent \textsc{Keywords:} Stochastic optimal control; value iteration; input-affine systems; Fenchel duality; computational complexity.

9: \end{abstract}

10: