Guide · Updated 2026
Free courses on LLMs and transformers
Short answer
The best free way to learn how large language models work is Andrej Karpathy's Neural Networks: Zero to Hero, where you build a GPT yourself. For building apps with open models, take the free Hugging Face LLM Course; for the theory, Stanford CS224n's lectures are public.
Our picks
How chatbots work, in plain English
AI in Bed: Advanced level
AI in Bed · Transformers, LLM training, RAG, agents and fine-tuning in short lessons. No sign-up.
Seeing a transformer work
The Illustrated Transformer
Jay Alammar · Jay Alammar's famous visual walkthrough of attention and the transformer.
Playing with GPT-2 in the browser
Transformer Explainer
Georgia Tech Polo Club · MIT · Type your own text and watch every step of a real model.
Building a GPT from scratch
Neural Networks: Zero to Hero
Andrej Karpathy · MIT (code) · Karpathy codes a language model step by step in Python.
Building with open models
Hugging Face LLM Course
Hugging Face · Apache 2.0 · Transformers, tokenisers, fine-tuning and LLM apps with open tools.
Building agents
Hugging Face AI Agents Course
Hugging Face · Apache 2.0 · Tool-using agents with open frameworks, hands-on.
The university course
CS224n: NLP with Deep Learning
Stanford University · Stanford's lectures from word vectors to modern LLMs.
Getting better answers
Prompt Engineering Guide
DAIR.AI · MIT · Techniques and examples for prompting any LLM.
Questions
Where can I learn about LLMs for free?
Karpathy's Zero to Hero, the Hugging Face LLM Course and Stanford CS224n are all free. AI in Bed's Advanced level is a gentler, plain-English start.
Do I need to know deep learning before learning LLMs?
For the ideas, no. To build or fine-tune models, it helps to know neural networks, backpropagation and embeddings first; see our free deep learning courses guide.
How long does it take to understand transformers?
An evening with The Illustrated Transformer gives you the big picture. Building one yourself with Karpathy's videos takes a few weekends.