Steepest Descent

Interactive tools and guided courses for the fundamentals of machine learning – read at the depth you choose.

The path

Five courses · foundations to the open edge

Primer

A gentle on-ramp – Curious mode only
0
AI PrimerCurious onlyNo prerequisites

Seven chapters of pure on-ramp – what a model is, how it learns from examples, and why a chatbot is a prediction machine rather than a mind. No equations anywhere.

Coming soon

Foundations

The machinery every model is built from
I
The Maths of LearningStart here

Vectors, matrices, derivatives, gradients, probability and entropy – each one introduced at the moment a machine-learning mechanism needs it, and landing on that mechanism running live.

Coming soon
II
Machine LearningBuilds on The Maths of Learning

What a model is, what it means to be wrong, how being-less-wrong becomes a procedure you can run – and why scoring well on the data you trained on proves nothing at all.

Coming soon
III
Neural NetworksBuilds on Machine Learning

From a single artificial neuron to a trained network – what one unit computes, why stacking them buys expressiveness, how backpropagation assigns credit, and what depth actually learns.

Coming soon

Core

Where the pieces become a language model
IV
Language ModelsBuilds on Neural Networks

Tokens, embeddings, attention as a data-dependent weighted average, the transformer block, and how a distribution over next tokens becomes text. The mechanism, not the product.

Coming soon

Deep dives

One idea, one page

Short, standalone reads that take a single idea past where the course leaves it. Coming soon.

Interactive tools

What is this? · About the project →

Steepest Descent

Interactive tools and guided courses for the fundamentals of machine learning – read at the depth you choose.

The path

Five courses · foundations to the open edge

Primer

A gentle on-ramp – Curious mode only
0
AI PrimerCurious onlyNo prerequisites

Seven chapters of pure on-ramp – what a model is, how it learns from examples, and why a chatbot is a prediction machine rather than a mind. No equations anywhere.

Coming soon

Foundations

The machinery every model is built from
I
The Maths of LearningStart here

Vectors, matrices, derivatives, gradients, probability and entropy – each one introduced at the moment a machine-learning mechanism needs it, and landing on that mechanism running live.

Coming soon
II
Machine LearningBuilds on The Maths of Learning

What a model is, what it means to be wrong, how being-less-wrong becomes a procedure you can run – and why scoring well on the data you trained on proves nothing at all.

Coming soon
III
Neural NetworksBuilds on Machine Learning

From a single artificial neuron to a trained network – what one unit computes, why stacking them buys expressiveness, how backpropagation assigns credit, and what depth actually learns.

Coming soon

Core

Where the pieces become a language model
IV
Language ModelsBuilds on Neural Networks

Tokens, embeddings, attention as a data-dependent weighted average, the transformer block, and how a distribution over next tokens becomes text. The mechanism, not the product.

Coming soon

Deep dives

One idea, one page

Short, standalone reads that take a single idea past where the course leaves it. Coming soon.

Interactive tools

What is this? · About the project →