Paper 2, Section II, J
Let be a continuous-time Markov chain on the finite state space . Define the terms generator (or Q-matrix) and invariant distribution, and derive an equation that links the generator and any invariant distribution . Comment on the possible non-uniqueness of invariant distributions.
Suppose is irreducible, and let be a Poisson process with intensity , that is independent of . Let be the value of immediately after the th arrival-time of (and . Show that is a discrete-time Markov chain, state its transition matrix and prove that it has the same invariant distribution as .
Typos? Please submit corrections to this page on GitHub.