1: \begin{abstract}

2:  Several attempts to dampen the curse of dimensionnality problem of the Dynamic Programming approach for solving multistage optimization problems

3:  have been investigated. One popular way to address this issue is the Stochastic Dual Dynamic Programming method

4:  (SDDP) introduced by Perreira and Pinto in 1991 for Markov Decision Processes. Assuming that the value

5:  function is convex (for a minimization problem), one builds a non-decreasing sequence of lower (or outer) convex approximations

6:  of the value function. Those convex approximations are constructed as a supremum of affine cuts.

7: 

8:  On continuous time deterministic optimal control problems, assuming that the value function

9:  is semiconvex, Zheng Qu, inspired by the work of McEneaney, introduced in 2013 a stochastic max-plus scheme that builds upper (or inner) non-increasing

10:  approximations of the value function.

11: 

12:  In this note, we build a common framework for both the SDDP and a discrete time version of Zheng Qu's algorithm to solve deterministic multistage optimization problems. Our algorithm generates monotone approximations of the value functions as a pointwise supremum, or infimum, of basic (affine or quadratic for example) functions which are randomly selected.

13:  We give sufficient conditions on the way basic functions are selected in order to ensure almost sure convergence of the approximations to the value function on a set of interest.

14: \end{abstract}

15: