Mathematics Tripos Papers

  • Part IA
  • Part IB
  • Part II
  • FAQ

1.I.4G

Coding and Cryptography | Part II, 2008

Define the entropy H(X)H(X)H(X) of a random variable XXX that takes no more than NNN different values. What are the maximum and the minimum values for the entropy for a fixed value of NNN ? Explain when the maximum and minimum are attained. You should prove any inequalities that you use.

Typos? Please submit corrections to this page on GitHub.