Skip to content
Free public beta until December 4, 2026: every course is open, no card needed. After that, the first chapter of each course stays free and full access is a one-time $39 ($19 for up to 100 founding members chosen for helpful feedback). Your progress is kept. How the beta works

cross-entropy

The average number of bits it costs to code outcomes drawn from the true distribution P, using a code built for a different distribution Q.

H(P,Q) = -\sum_x P(x)\log Q(x) = E_P[-\log Q(X)].

Read the full section →
Graph settings

Calculator