📚 node [[stochastic_gradient_descent_(sgd)]]
📓
garden/KGBicheno/Artificial Intelligence/Introduction to AI/Week 3 - Introduction/Definitions/Stochastic_Gradient_Descent_(Sgd).md by @KGBicheno
stochastic gradient descent (SGD)
Go back to the [[AI Glossary]]
A gradient descent algorithm in which the batch size is one. In other words, SGD relies on a single example chosen uniformly at random from a dataset to calculate an estimate of the gradient at each step.
📖 stoas
- public document at doc.anagora.org/stochastic_gradient_descent_(sgd)
- video call at meet.jit.si/stochastic_gradient_descent_(sgd)
⥅ related node [[mini batch_stochastic_gradient_descent_(sgd)]]
🔎 full text search for 'stochastic_gradient_descent_(sgd)'