Ergodic Markov chainmaths probability Ergodic Markov chainA Markov chain is said to be ergodic if it is both aperiodic and irreducible.