deep-learning
Pretrained Transformer families (encoder-only, decoder-only, encoder-decoder)
taught
Taught in
-
Encoder-only, decoder-only, and encoder-decoder families
Deep Learning / Neural Networks
-
Language models at scale: a preview
Deep Learning / Neural Networks
-
The Transformer block and decoder-only models
Wiring Language Models
Requires
- transformer-architecture required
Required by
- Context windows and KV caching required
- Loading and inspecting a pretrained model required
Local knowledge map
Local knowledge map
Click to expand
Solid arrows are required prerequisites; dashed are recommended or helpful. Lower rows are more foundational. Click any box to jump to that concept.