====== Sandbox ====== ===== MI-SPI ===== ^ X_1 ^ 1 ^ 2 ^ | P(X_1 = x_1) | \frac{1}{2} | \frac{1}{2} | P=\left( \begin{matrix} 0 & 1 \\ \frac{1}{2} & \frac{1}{2} \\ \end{matrix} \right) \Rightarrow X_1*P=X_2 ^ X_2 ^ 1 ^ 2 ^ | P(X_2 = x_2) | \frac{1}{4} | \frac{3}{4} | ^ X_1 / X_2 ^ 1 ^ 2 ^ | 1 | \frac{1}{8} | \frac{3}{8} | | 2 | \frac{1}{8} | \frac{3}{8} | H(X_1|X_2) = - \sum_{\forall x_1} \sum_{\forall x_2} P(X_1=x_1,X_2=x_2) \cdot log_{b}{ \frac{P(X_1=x_1,X_2=x_2)}{P(X_2=x_2)} } \quad = \quad -2 \cdot \frac{1}{8} \cdot \log_{2}{\frac{\frac 1 8}{\frac 1 4}} -2 \cdot \frac{3}{8} \cdot \log_{2}{\frac{\frac 3 8}{\frac 3 4}} \quad = \quad - \frac{1}{4} \cdot (-1) - \frac{3}{4} \cdot (-1) = 1