1: \begin{abstract}
2: Markov jump processes are widely used to model natural and engineered processes. In the context of biological or
3: chemical applications one typically refers to the chemical master equation
4: (CME), which models the evolution of the probability mass of any copy-number
5: combination of the interacting particles. When many interacting particles
6: (``species'') are considered, the complexity of the CME quickly increases,
7: making direct numerical simulations impossible. This is even more problematic
8: when one aims at \textit{controlling} the Markov jump processes defined by the CME.
9:
10: In this work, we study both \textit{open loop} and \textit{feedback} optimal control problems of the Markov jump
11: processes in the case that the controls can only be
12: switched at fixed control stages. Based on Kurtz's limit theorems, we prove the convergence of the respective control value
13: functions of the underlying Markov decision problem as the copy numbers of the species go to infinity.
14: In the case of the optimal
15: control problem on a finite time-horizon, we propose a hybrid control policy algorithm to overcome the difficulties due to the
16: curse of dimensionality when the copy number of the involved species is large.
17: Two numerical examples demonstrate the suitability of both the analysis and the proposed algorithms.
18: \end{abstract}
19: