← All questions
EvaluationMedium· Benchmarking· Saturation· Model Evaluation

MMLU scores have been in the 90s for a year. Is the ben...

While MMLU is still a valid tool for basic diagnostics, it no longer provides useful ranking signals for top-tier models because it has reached a saturation threshold of approximately 90%. The industry has largely shifted toward more challenging benchmarks like MMLU-Pro and GPQA, which have higher saturation thresholds and better discriminative power.

Code playground (Python)