LSTM
A recurrent architecture with gates that let it selectively remember or forget information over long sequences.
Examples
An LSTM's forget gate can learn to keep a subject's gender in its cell state across dozens of words until a pronoun needs it.
See also
Point table
Graph settings
Calculator