Batch — A batch is a small group of training examples processed together before the model updates its parameters. Batching makes training faster and more stable. Batch size is one of the settings chosen before training. Large models train on very large batches across many chips.

Added October 21, 2026