1.I.4G
Define the entropy of a random variable that takes no more than different values. What are the maximum and the minimum values for the entropy for a fixed value of ? Explain when the maximum and minimum are attained. You should prove any inequalities that you use.
Typos? Please submit corrections to this page on GitHub.