📕 subnode [[@KGBicheno/gradient_clipping]] in 📚 node [[gradient_clipping]]

gradient clipping

Go back to the [[AI Glossary]]

#seq

A commonly used mechanism to mitigate the exploding gradient problem by artificially limiting (clipping) the maximum value of gradients when using gradient descent to train a model.

📖 stoas
⥱ context