State and prove Gibbs' inequality.

Show that, for a pair of discrete random variables $X$ and $Y$, each taking finitely many values, the joint entropy $H(X, Y)$ satisfies

$$H(X, Y) \leqslant H(X)+H(Y)$$

with equality precisely when $X$ and $Y$ are independent.