๐ Agora location [[learning_rate]] โ
Agora locations contain community contributions with titles or topics that match your search.
๐ Artificial Intelligence/Introduction to AI/Week 3 - Introduction/Definitions/Learning_Rate.md by @KGBicheno โ raw
learning rate
Go back to the [[AI Glossary]]
A scalar used to train a model via gradient descent. During each iteration, the gradient descent algorithm multiplies the learning rate by the gradient. The resulting product is called the gradient step.
Learning rate is a key hyperparameter.
Loading pushes...
โจ AI Synthesis Mistral Gemini ChatGPT Claude
Expanding this section will automatically generate an AI synthesis of the contributions in this node.