1: \begin{abstract}
2: Stochastic dual dynamic programming is
3: a cutting plane type algorithm for multi-stage stochastic optimization originated about 30 years ago.
4: In spite of its popularity in practice, there does not
5: exist any analysis on the convergence rates of this method. In
6: this paper, we first establish the number of iterations, i.e., iteration complexity, required by
7: a basic dual dynamic programming method for solving single-scenario multi-stage optimization problems,
8: by introducing novel mathematical tools including the saturation of search points.
9: We then refine these basic tools and
10: establish the iteration complexity for
11: an explorative dual dynamic programing method proposed herein and
12: the classic stochastic dual dynamic programming method for solving more
13: general multi-stage stochastic optimization problems under the standard stage-wise
14: independence assumption. Our results indicate that the complexity of some of these methods
15: mildly increases with the number of stages $T$, in fact linearly dependent on $T$
16: for discounted problems. Therefore, they are efficient for strategic decision making which
17: involves a large number of stages,
18: but with a relatively small number of
19: decision variables in each stage. Without explicitly
20: discretizing the state and action spaces, these methods might also be
21: pertinent to the related reinforcement learning and stochastic control areas.
22:
23: \end{abstract}
24: