Transformers & Attention from Scratch
Intermediate
Build the architecture behind modern language models, one equation at a time.
The academy
Each course is a labyrinth: rings of chambers that mix video, mathematics, interactive labs and research practice, with a boss waiting at the centre.
Available now · Beginner
Learn to read the language every machine-learning paper is written in.
Available now · Beginner
Vectors, matrices and the geometry hiding inside every model.
Available now · Beginner
Limits, gradients and integrals: the mathematics of how models learn.
Available now · Beginner
Uncertainty, likelihood and the maths of learning from noisy data.
Available now · Beginner
From a single neuron to your first research write-up.
Available now · Intermediate
How LLMs work, how to steer them, and how to ship them without fooling yourself.
New labyrinths being built. Each will plug into the same XP, badges and Codex.
Intermediate
Build the architecture behind modern language models, one equation at a time.
Intermediate
Rewards, policies and value functions, from bandits to deep RL.
Advanced
Teach machines to imagine, and learn to measure what they make.
Intermediate
Pick problems, run a lab notebook, survive peer review and give great talks.