Paper 1, Section I, G
Let and be discrete random variables taking finitely many values. Define the conditional entropy . Suppose is another discrete random variable taking values in a finite alphabet, and prove that
[You may use the equality and the inequality
State and prove Fano's inequality.
Typos? Please submit corrections to this page on GitHub.