条件互信息

来自集智百科 - 复杂系统|人工智能|复杂科学|复杂网络|自组织
Moonscar讨论 | 贡献2020年10月25日 (日) 17:50的版本 (Moved page from wikipedia:en:Conditional mutual information (history))
跳到导航 跳到搜索

此词条暂由彩云小译翻译,翻译字数共57,未经人工整理和审校,带来阅读不便,请见谅。

模板:Information theory


Venn diagram of information theoretic measures for three variables [math]\displaystyle{ x }[/math], [math]\displaystyle{ y }[/math], and [math]\displaystyle{ z }[/math], represented by the lower left, lower right, and upper circles, respectively. The conditional mutual informations [math]\displaystyle{ I(x;z|y) }[/math], [math]\displaystyle{ I(y;z|x) }[/math] and [math]\displaystyle{ I(x;y|z) }[/math] are represented by the yellow, cyan, and magenta regions, respectively.

[[Venn diagram of information theoretic measures for three variables [math]\displaystyle{ x }[/math], [math]\displaystyle{ y }[/math], and [math]\displaystyle{ z }[/math], represented by the lower left, lower right, and upper circles, respectively. The conditional mutual informations [math]\displaystyle{ I(x;z|y) }[/math], [math]\displaystyle{ I(y;z|x) }[/math] and [math]\displaystyle{ I(x;y|z) }[/math] are represented by the yellow, cyan, and magenta regions, respectively.]]

[三个变量的信息理论度量维恩图分别代表左下、右下和上圆。条件互信息 < math > i (x; z | y) </math > ,< math > i (y; z | x) </math > 和 < math > i (x; y | z) </math > 分别由黄色、青色和品红色区域表示。]


In probability theory, particularly information theory, the conditional mutual information[1][2] is, in its most basic form, the expected value of the mutual information of two random variables given the value of a third.

In probability theory, particularly information theory, the conditional mutual information

在概率论理论中,特别是信息论中,条件互信息


Definition

Category:Information theory

范畴: 信息论

For random variables [math]\displaystyle{ X }[/math], [math]\displaystyle{ Y }[/math], and [math]\displaystyle{ Z }[/math] with support sets [math]\displaystyle{ \mathcal{X} }[/math], [math]\displaystyle{ \mathcal{Y} }[/math] and [math]\displaystyle{ \mathcal{Z} }[/math], we define the conditional mutual information as

Category:Entropy and information

类别: 熵和信息


This page was moved from wikipedia:en:Conditional mutual information. Its edit history can be viewed at 条件互信息/edithistory

  1. Wyner, A. D. (1978). "A definition of conditional mutual information for arbitrary ensembles". Information and Control. 38 (1): 51–59. doi:10.1016/s0019-9958(78)90026-8.
  2. Dobrushin, R. L. (1959). "General formulation of Shannon's main theorem in information theory". Uspekhi Mat. Nauk. 14: 3–104.