Skip to content
Free public beta until December 4, 2026: every course is open, no card needed. After that, the first chapter of each course stays free and full access is a one-time $39 ($19 for up to 100 founding members chosen for helpful feedback). Your progress is kept. How the beta works

language-models

Vision-language models

taught

A model that takes both an image and text as input and reasons about them jointly -- answering a question about an image, describing what it shows -- extending this course's text-only architecture (recall ch.00's decoder-only shape) with an image encoder feeding into the same kind of model.

Taught in

Requires

  • decoder-only-causal-lm-shape recommended

    A vision-language model is this course's own decoder-only shape with an added image-encoding front end, not a wholly different architecture.

  • zero-shot-classification-and-retrieval-via-vlm recommended

    computer-vision's own VLM skill goes deeper on zero-shot classification/retrieval via a vision-language model than this course's own working-depth treatment needs to.

Required by

Nothing in the catalog needs this yet.

Local knowledge map

Local knowledge map

Click to expand

Solid arrows are required prerequisites; dashed are recommended or helpful. Lower rows are more foundational. Click any box to jump to that concept.