Guide · Updated 2026

Free courses on LLMs and transformers

Short answer

The best free way to learn how large language models work is Andrej Karpathy's Neural Networks: Zero to Hero, where you build a GPT yourself. For building apps with open models, take the free Hugging Face LLM Course; for the theory, Stanford CS224n's lectures are public.

Our picks

  1. How chatbots work, in plain English

    AI in Bed: Advanced level

    AI in Bed · Transformers, LLM training, RAG, agents and fine-tuning in short lessons. No sign-up.

  2. Seeing a transformer work

    The Illustrated Transformer

    Jay Alammar · Jay Alammar's famous visual walkthrough of attention and the transformer.

  3. Playing with GPT-2 in the browser

    Transformer Explainer

    Georgia Tech Polo Club · MIT · Type your own text and watch every step of a real model.

  4. Building a GPT from scratch

    Neural Networks: Zero to Hero

    Andrej Karpathy · MIT (code) · Karpathy codes a language model step by step in Python.

  5. Building with open models

    Hugging Face LLM Course

    Hugging Face · Apache 2.0 · Transformers, tokenisers, fine-tuning and LLM apps with open tools.

  6. Building agents

    Hugging Face AI Agents Course

    Hugging Face · Apache 2.0 · Tool-using agents with open frameworks, hands-on.

  7. The university course

    CS224n: NLP with Deep Learning

    Stanford University · Stanford's lectures from word vectors to modern LLMs.

  8. Getting better answers

    Prompt Engineering Guide

    DAIR.AI · MIT · Techniques and examples for prompting any LLM.

Questions

Where can I learn about LLMs for free?

Karpathy's Zero to Hero, the Hugging Face LLM Course and Stanford CS224n are all free. AI in Bed's Advanced level is a gentler, plain-English start.

Do I need to know deep learning before learning LLMs?

For the ideas, no. To build or fine-tune models, it helps to know neural networks, backpropagation and embeddings first; see our free deep learning courses guide.

How long does it take to understand transformers?

An evening with The Illustrated Transformer gives you the big picture. Building one yourself with Karpathy's videos takes a few weekends.

More free guides