📐
Cross-Entropy & Gibbs' Inequality Sprint
Compute H(P,Q) directly, then judge whether D(P||Q) can dip below 0 -- it can't, and Gibbs' inequality is why.
⏱️ 90s
▶ Log in to play
Compute H(P,Q) directly, then judge whether D(P||Q) can dip below 0 -- it can't, and Gibbs' inequality is why.