📚 node [[gradient]]

gradient

Go back to the [[AI Glossary]]

The vector of partial derivatives with respect to all of the independent variables. In machine learning, the gradient is the vector of partial derivatives of the model function. The gradient points in the direction of steepest ascent.

📖 stoas
⥱ context
⥅ related node [[exploding_gradient_problem]]
⥅ related node [[gradient_clipping]]
⥅ related node [[gradient_descent]]
⥅ related node [[mini batch_stochastic_gradient_descent_(sgd)]]
⥅ related node [[stochastic_gradient_descent_(sgd)]]
⥅ related node [[vanishing_gradient_problem]]
⥅ related node [[intimacy gradient]]