3,061
个编辑
更改
→定义有效信息
\begin{aligned}
\begin{aligned}
{J} &=\frac{1}{N}\sum_{i=1}^ND_{KL}[W_i^{out}||<W_i^{out}>] \\
{J} &=\frac{1}{N}\sum_{i=1}^ND_{KL}[W_i^{out}||<W_i^{out}>] \\
&= \frac{1}{N}\sum_{i=1}^N\sum_{j=1}^Nw_{ij}\log_2(w_{ij})-\frac{1}{N}\sum_{i=1}^N\sum_{j=1}^Nw_{ij}log_2(W_j) \\
&= \frac{1}{N}\sum_{i=1}^N\sum_{j=1}^Nw_{ij}\log_2(w_{ij})-\frac{1}{N}\sum_{i=1}^N\sum_{j=1}^Nw_{ij}\log_2(W_j) \\
&= H(<W_i^{out}>)-<H(W_i^{out})>
&= H(<W_i^{out}>)-<H(W_i^{out})>
\end{aligned}
\end{aligned}