更改

{{Information theory}}

{{Information theory}}

 

[[文件:Entropy-mutual-information-relative-entropy-relation-diagram.svg|缩略图|右|该图表示在变量X、Y相关联的各种信息量之间，进行加减关系的维恩图。两个圆所包含的区域是联合熵H(X,Y)。左侧的圆圈（红色和紫色）是单个熵H（X），红色是条件熵H（X ǀ Y）。右侧的圆圈（蓝色和紫色）为H（Y），蓝色为H（Y ǀ X）。中间紫色的是相互信息i（X; Y）。]]

 

[[Image:Entropy-mutual-information-relative-entropy-relation-diagram.svg|thumb|256px|right|A misleading<ref>{{Cite book|author=D.J.C. Mackay|title= Information theory, inferences, and learning algorithms}}{{rp|141}}</ref> [[Venn diagram]] showing additive, and subtractive relationships between various [[Quantities of information|information measures]] associated with correlated variables X and Y. The area contained by both circles is the [[joint entropy]] H(X,Y). The circle on the left (red and violet) is the [[Entropy (information theory)|individual entropy]] H(X), with the red being the [[conditional entropy]] H(X{{!}}Y). The circle on the right (blue and violet) is H(Y), with the blue being H(Y{{!}}X). The violet is the [[mutual information]] I(X;Y).]]

 

[[Image:Entropy-mutual-information-relative-entropy-relation-diagram.svg|thumb|256px|right|A misleading

[[Image:Entropy-mutual-information-relative-entropy-relation-diagram.svg|thumb|256px|right|A misleading