AI glossary
What is learning rate?
Short answer
The step size used in gradient descent.
For example
Too large a learning rate and training jumps past the best answer and bounces around; too small and it crawls for days.
Learn it in a free lesson
Related terms
Questions
What is learning rate in simple terms?
The step size used in gradient descent.
What is an example of learning rate?
Too large a learning rate and training jumps past the best answer and bounces around; too small and it crawls for days.
Where can I learn about learning rate for free?
AI in Bed explains it in the free lesson "Gradient descent: rolling downhill" (Intermediate level, 6 minutes), with no sign-up.