1: \begin{abstract}

2:     This work presents a \textit{low-rank tensor} model for \textit{multi-dimensional Markov chains}.

3:     A common approach to simplify the dynamical behavior of a Markov chain is to impose low-rankness on the transition probability matrix.

4:     Inspired by the success of these matrix techniques, we present low-rank tensors for representing transition probabilities on multi-dimensional state spaces.

5:     Through tensor decomposition, we provide a connection between our method and classical probabilistic models.

6:     Moreover, our proposed model yields a parsimonious representation with fewer parameters than matrix-based approaches.

7:     Unlike these methods, which impose low-rankness uniformly across all states, our tensor method accounts for the multi-dimensionality of the state space.

8:     We also propose an optimization-based approach to estimate a Markov model as a low-rank tensor.

9:     Our optimization problem can be solved by the alternating direction method of multipliers (ADMM), which enjoys convergence to a stationary solution.

10:     We empirically demonstrate that our tensor model estimates Markov chains more efficiently than conventional techniques, requiring both fewer samples and parameters.

11:     We perform numerical simulations for both a synthetic low-rank Markov chain and a real-world example with New York City taxi data, showcasing the advantages of multi-dimensionality for modeling state spaces.

12: \end{abstract}

13: