463
个编辑
更改
跳到导航
跳到搜索
第241行：
第241行： − 对于联合的离散或连续分布的变量对<math>(X,Y)</math>,+
→与相对熵的关系 Relation to Kullback–Leibler divergence
For jointly discrete or jointly continuous pairs <math>(X,Y)</math>,
For jointly discrete or jointly continuous pairs <math>(X,Y)</math>,
对于联合的离散或连续分布变量对<math>(X,Y)</math>，
mutual information is the [[Kullback–Leibler divergence]] of the product of the [[marginal distribution]]s, <math>p_X \cdot p_Y</math>, from the [[joint distribution]] <math>p_{(X,Y)}</math>, that is,
mutual information is the [[Kullback–Leibler divergence]] of the product of the [[marginal distribution]]s, <math>p_X \cdot p_Y</math>, from the [[joint distribution]] <math>p_{(X,Y)}</math>, that is,