Skip to content
Free public beta until December 4, 2026: every course is open, no card needed. After that, the first chapter of each course stays free and full access is a one-time $39 ($19 for up to 100 founding members chosen for helpful feedback). Your progress is kept. How the beta works

relative entropy

A measure of how different one probability distribution is from another, never negative and zero only when they match.

For distributions P,Q on the same alphabet, D(P\|Q) = \sum_x P(x)\log\frac{P(x)}{Q(x)}.

Read the full section →
Graph settings

Calculator