Ergodic Markov chain limiting distrubution
maths
Statement
Lemma
For an Ergodic Markov chain with unique stationary distribution $\pi$ we have
$$\lim_{k \rightarrow \infty} P^k = \left ( \begin{array} \ \cdots & \pi & \cdots\\ \cdots & \pi & \cdots\\ \vdots & \vdots & \vdots\\ \cdots & \pi & \cdots\\ \end{array}\right ).$$