📚 node [[gradient_descent]]

gradient descent

Go back to the [[AI Glossary]]

A technique to minimize loss by computing the gradients of loss with respect to the model's parameters, conditioned on training data. Informally, gradient descent iteratively adjusts parameters, gradually finding the best combination of weights and bias to minimize loss.

📖 stoas
⥱ context
⥅ related node [[mini batch_stochastic_gradient_descent_(sgd)]]
⥅ related node [[stochastic_gradient_descent_(sgd)]]