Skip to content
Free public beta until December 4, 2026: every course is open, no card needed. After that, the first chapter of each course stays free and full access is a one-time $39 ($19 for up to 100 founding members chosen for helpful feedback). Your progress is kept. How the beta works

floating-point number

A computer's usual way to store a real number: a sign, a fixed number of significant digits (the mantissa), and a power-of-two exponent that slides the decimal point.

A floating-point number is stored as sign \times mantissa \times (base)^{\text{exponent}}, with the mantissa held to a fixed number of bits -- so it represents an exact value only when that value lands exactly on the format's own grid, and rounds to the nearest grid point otherwise.

Examples

  • 6.5 = 1.101_2\times2^2 stores exactly; 0.1 (a repeating binary fraction) does not, and rounds to the nearest representable neighbor instead.

Read the full section →
Graph settings

Calculator