AI glossary
What is batch / mini-batch?
Short answer
A small group of training examples processed together in one optimisation step.
For example
Instead of updating a model after every one of a million photos, training might look at 64 photos at a time, average their errors and take one step.
Learn it in a free lesson
- Gradient descent: rolling downhillIntermediate · 6 min
- How models are served: prefill, decode and the KV cacheAdvanced · 8 min
Questions
What is batch / mini-batch in simple terms?
A small group of training examples processed together in one optimisation step.
What is an example of batch / mini-batch?
Instead of updating a model after every one of a million photos, training might look at 64 photos at a time, average their errors and take one step.
Where can I learn about batch / mini-batch for free?
AI in Bed explains it in the free lesson "Gradient descent: rolling downhill" (Intermediate level, 6 minutes), with no sign-up.