Using Jensen's inequality on the definition of mutual information we can show that <math>\operatorname{I}(X;Y)</math> is non-negative, i.e. | Using Jensen's inequality on the definition of mutual information we can show that <math>\operatorname{I}(X;Y)</math> is non-negative, i.e. |