AI glossary
What is parameters / weights?
Short answer
The learned numbers inside a model that determine its behaviour.
For example
A small model might have a few thousand parameters; frontier language models have hundreds of billions, all set during training.
Learn it in a free lesson
- How machines learnBeginner · 5 min
- Neural networks, gentlyBeginner · 6 min
- Open-weight models and running AI yourselfIntermediate · 6 min
- Scaling laws, evals & safetyAdvanced · 7 min
- Mixture of experts: big models, small billsAdvanced · 8 min
- Backpropagation: blame, passed backwardsIntermediate · 6 min
Related terms
Questions
What is parameters / weights in simple terms?
The learned numbers inside a model that determine its behaviour.
What is an example of parameters / weights?
A small model might have a few thousand parameters; frontier language models have hundreds of billions, all set during training.
Where can I learn about parameters / weights for free?
AI in Bed explains it in the free lesson "How machines learn" (Beginner level, 5 minutes), with no sign-up.