MMLU — MMLU, short for Massive Multitask Language Understanding, is a benchmark of multiple-choice questions across 57 subjects, from law to physics. For years it was a standard measure of a model’s general knowledge. Leading models now score very high, so harder benchmarks have taken its place. Its rise and saturation show how fast AI progressed.

Added October 21, 2026