4.I.9C
For a Markov chain with state space , define what is meant by the following:
(i) states communicate;
(ii) state is recurrent.
Prove that communication is an equivalence relation on and that if two states communicate and is recurrent then is recurrent.
Typos? Please submit corrections to this page on GitHub.