Epoch — An epoch is one complete pass through the entire training dataset. Smaller models often train for many epochs. The largest language models often see most of their data only once or a few times. Too many epochs can lead to overfitting.

Added October 21, 2026