← All questions
EvaluationMedium· Benchmarking· Model Selection· Deployment

Which benchmark would you use to evaluate a new 70B mod...

Evaluation strategy should be tailored to the deployment use case. For general-purpose assistants, MMLU-Pro provides a meaningful signal. For specialized domains like medical or legal, you should supplement this with GPQA on relevant subsets. You should avoid using plain MMLU for frontier-sized models because they have hit the ceiling, rendering the benchmark ineffective for differentiation.

Code playground (Python)