Skip to content
Free public beta until December 4, 2026: every course is open, no card needed. After that, the first chapter of each course stays free and full access is a one-time $39 ($19 for up to 100 founding members chosen for helpful feedback). Your progress is kept. How the beta works

query, key, and value

The three vectors an attention mechanism derives from its input to decide what to look up and what to retrieve.

Examples

  • A query vector is compared against every key vector to produce weights, which then combine the value vectors into one output.

Read the full section →
Graph settings

Calculator