Periodic state (markov chain)

maths probability
Periodic state (markov chain)

For a Markov chain given by $P \in M_{N,N}(\mathbb{R})$ a state $i$ with $1 \leq i \leq N$ is said to be aperidoic if

$$gcd(\{n \in \mathbb{N} \vert P^n \mbox{ has non-zero } i'th \mbox{ diagonal value} \}) = 1$$

and is periodic otherwise.