Track · Students and engineers who want depth
ML engineer
The maths and machinery, start to frontier.
A full path from fitting a line to training and aligning large models, with code you can run along the way.
0 of 17 finished
- Lines and curves: regressionThe humble straight line is the ancestor of every neural network. Linear and logistic regression, explained.
- Gradient descent: rolling downhillHow models find good weights: feel the slope, take a small step down, repeat.
- Overfitting & the Goldilocks modelToo simple misses the pattern, too complex memorises the noise. How to land just right.
- Decision trees and random forestsA game of twenty questions that learns from data, and why a whole forest of them still beats neural networks on spreadsheets.
- Finding groups: clusteringHow a computer can sort things into groups when nobody has told it what the groups are, with k-means step by step.
- Is my model any good?Accuracy can lie. Meet the confusion matrix, precision, recall and F1.
- Backpropagation: blame, passed backwardsHow a network with millions of weights figures out which ones to adjust.
- Seeing and remembering: CNNs & RNNsSpecial network shapes for images and sequences, and why they mattered.
- Embeddings: meaning as mapsHow AI turns words, images and songs into points in space where closeness means similarity.
- Attention is all you needThe transformer architecture and the attention mechanism that powers every modern LLM.
- How LLMs are trainedPre-training, supervised fine-tuning, and learning from feedback: the three-stage recipe.
- Mixture of experts: big models, small billsHow some of the largest models only use a small slice of themselves for each token, and what that saves and costs.
- Distillation and the rise of small modelsHow a big model can teach a small one, why small models keep getting better, and when a little model is the right choice.
- Reinforcement learning, deeperPolicies, values and rewards: the maths of learning by doing.
- Thinking before answering: reasoning modelsWhy letting a model write out its thinking makes it smarter, and how reinforcement learning taught models to think for longer.
- Scaling laws, evals & safetyWhy bigger got better, how we measure frontier models, and the open problems in keeping AI safe.
- Keeping AI on our side: alignment and interpretabilityHow developers try to make models helpful, honest and harmless, how they test for danger, and how researchers are learning to read a model's mind.
Read it offline
Save all of this track on this device for flights, trains and bad Wi-Fi.