deep-learning
Multi-head attention
taught
Taught in
-
Multi-head attention
Deep Learning / Neural Networks
-
The Transformer block and decoder-only models
Wiring Language Models
Requires
- scaled-dot-product-attention required
Required by
- Self-attention required
Local knowledge map
Local knowledge map
Click to expand
Solid arrows are required prerequisites; dashed are recommended or helpful. Lower rows are more foundational. Click any box to jump to that concept.