2.II.22H
Consider a Markov chain on the state space with transition probabilities as illustrated in the diagram below, where and .
For each value of , determine whether the chain is transient, null recurrent or positive recurrent.
When the chain is positive recurrent, calculate the invariant distribution.
Typos? Please submit corrections to this page on GitHub.