📚 node [[stochastic_gradient_descent_(sgd)]]

📓
garden/KGBicheno/Artificial Intelligence/Introduction to AI/Week 3 - Introduction/Definitions/Stochastic_Gradient_Descent_(Sgd).md by @KGBicheno

### stochastic gradient descent (SGD)

Go back to the [[AI Glossary]]

A gradient descent algorithm in which the batch size is one. In other words, SGD relies on a single example chosen uniformly at random from a dataset to calculate an estimate of the gradient at each step.

📖 stoas

- public document at doc.anagora.org/stochastic_gradient_descent_(sgd)
- video call at meet.jit.si/stochastic_gradient_descent_(sgd)

⥅ related node [[mini batch_stochastic_gradient_descent_(sgd)]]

🔎 full text search for 'stochastic_gradient_descent_(sgd)'