Gradient descent — Gradient descent is the method most models use to learn. It calculates which direction to nudge each parameter to reduce the loss, then takes a small step in that direction. Repeating this millions of times gradually improves the model. Most modern AI training is a form of gradient descent.

Added October 21, 2026