gradient clipping

Go back to the [[AI Glossary]]

#seq

A commonly used mechanism to mitigate the exploding gradient problem by artificially limiting (clipping) the maximum value of gradients when using gradient descent to train a model.