📕 subnode [[@KGBicheno/adagrad]] in 📚 node [[adagrad]]

AdaGrad

Go back to the [[AI Glossary]]

A sophisticated gradient descent algorithm that rescales the gradients of each parameter, effectively giving each parameter an independent learning rate. For a full explanation, see this paper.

📖 stoas
⥱ context