Free public beta until December 4, 2026: every course is open, no card needed. After that, the first chapter of each course stays free and full access is a one-time $39 ($19 for up to 100 founding members chosen for helpful feedback). Your progress is kept. How the beta works

leaky ReLU

ReLU with a small nonzero slope on the negative side instead of a hard floor at zero, so a unit stuck on the negative side still receives a nonzero reading.

Examples

With slope 0.1, $\mathrm{LeakyReLU}(-2) = -0.2$ , instead of plain ReLU's flat $0$ .