Ergodic Markov chain limiting distrubution

maths

Statement

Lemma

For an Ergodic Markov chain with unique stationary distribution $\pi$ we have

$$\lim_{k \rightarrow \infty} P^k = \left ( \begin{array} \ \cdots & \pi & \cdots\\ \cdots & \pi & \cdots\\ \vdots & \vdots & \vdots\\ \cdots & \pi & \cdots\\ \end{array}\right ).$$

Proof