weight decay
A regularization technique that shrinks parameters toward zero during training, discouraging overly large weights.
Examples
Adding \lambda\|w\|^2 to the loss penalizes large weights, nudging every update slightly back toward zero.
See also
Point table
Graph settings
Calculator