๐ Agora node [[learning rate]] โ
Agora nodes contain community contributions with titles or topics that match your search.
๐ File Artificial Intelligence/Introduction to AI/Week 3 - Introduction/Definitions/Learning_Rate.md by @KGBicheno โ ๐ โถ
learning rateยง
Go back to the [[AI Glossary]]
A scalar used to train a model via gradient descent. During each iteration, the gradient descent algorithm multiplies the learning rate by the gradient. The resulting product is called the gradient step.
Learning rate is a key hyperparameter.
โจ AI Synthesis Mistral Gemini ChatGPT Claude
Expanding this section will automatically generate an AI synthesis of the contributions in this node.