1: \begin{definition}

2:   Assume $A = A_0 + A_1 + A_2$ is irreducible. Then, by the

3:   Perron--Frobenius Theorem, there exists a unique vector $\mu > 0$

4:   with ${\bf 1}^T \mu = 1$ and $A \mu = \mu$.  The vector $\mu$ is

5:   called the stationary probability vector of $A$, while ${\bf 1}$ is

6:   a column vector whose elements are all equal to one.

7: \end{definition}

8: