[[File:Entropy-mutual-information-relative-entropy-relation-diagram.svg|thumb|256px|right|[[Venn diagram]] showing additive and subtractive relationships various information measures associated with correlated variables <math>X</math> and <math>Y</math>. The area contained by both circles is the [[joint entropy]] <math>\Eta(X,Y)</math>. The circle on the left (red and violet) is the [[Entropy (information theory)|individual entropy]] <math>\Eta(X)</math>, with the red being the [[conditional entropy]] <math>\Eta(X|Y)</math>. The circle on the right (blue and violet) is <math>\Eta(Y)</math>, with the blue being <math>\Eta(Y|X)</math>. The violet is the [[mutual information]] <math>\operatorname{I}(X;Y)</math>. 维恩图,显示加性和减法关系与相关变量𝑋和𝑌相关的各种信息度量。两个圆所包含的面积就是联合熵。左边的圆圈(红色和紫色)是个体熵,红色是条件熵。右边的圆圈(蓝色和紫色)是,蓝色是。紫罗兰色是相互信息I(𝑋;𝑌)。]]
+
[[File:Entropy-mutual-information-relative-entropy-relation-diagram.svg|thumb|256px|right|[[Venn diagram]] showing additive and subtractive relationships various information measures associated with correlated variables <math>X</math> and <math>Y</math>. The area contained by both circles is the [[joint entropy]] <math>(X,Y)</math>. The circle on the left (red and violet) is the [[Entropy (information theory)|individual entropy]] <math>(X)</math>, with the red being the [[conditional entropy]] <math>(X|Y)</math>. The circle on the right (blue and violet) is <math>(Y)</math>, with the blue being <math>(Y|X)</math>. The violet is the [[mutual information]] <math>\operatorname{I}(X;Y)</math>. 维恩图,显示加性和减法关系与相关变量𝑋和𝑌相关的各种信息度量。两个圆所包含的面积就是联合熵。左边的圆圈(红色和紫色)是个体熵,红色是条件熵。右边的圆圈(蓝色和紫色)是,蓝色是。紫罗兰色是相互信息I(𝑋;𝑌)。]]
−
[[Venn diagram showing additive and subtractive relationships various information measures associated with correlated variables <math>X</math> and <math>Y</math>. The area contained by both circles is the joint entropy <math>\Eta(X,Y)</math>. The circle on the left (red and violet) is the individual entropy <math>\Eta(X)</math>, with the red being the conditional entropy <math>\Eta(X|Y)</math>. The circle on the right (blue and violet) is <math>\Eta(Y)</math>, with the blue being <math>\Eta(Y|X)</math>. The violet is the mutual information <math>\operatorname{I}(X;Y)</math>.]]
+
[[Venn diagram showing additive and subtractive relationships various information measures associated with correlated variables <math>X</math> and <math>Y</math>. The area contained by both circles is the joint entropy <math>(X,Y)</math>. The circle on the left (red and violet) is the individual entropy <math>(X)</math>, with the red being the conditional entropy <math>(X|Y)</math>. The circle on the right (blue and violet) is <math>(Y)</math>, with the blue being <math>(Y|X)</math>. The violet is the mutual information <math>\operatorname{I}(X;Y)</math>.]]