179 questions
No questions match those filters.
← All questions
EvaluationMedium· Alignment· Benchmarks· Overoptimization
How would you evaluate whether your post-training run actually improved the model?
This is one of the questions in the full AI/ML interview bank. Pro unlocks all 1789 questions; Premium includes the same bank plus the highest daily Practice limit.
See plansEvaluation must separate the proxy reward used during training from a held-out evaluation harness that is harder to game. The harness should include both capability benchmarks and a regression floor to ensure performance hasn’t degraded in critical areas. You must also actively watch for length confounds and the overoptimization cliff, where the model appears to improve on the reward but degrades in actual capability.