What happens to GRPO training when the model solves nea...

When the best-of-G pass rate approaches 100%, the group standard deviation vanishes, rendering the advantage calculation unstable. Training stalls because the model is no longer receiving useful gradient signals. To prevent this, one must continuously monitor pass rates and replace prompts that have been mastered with more challenging ones to ensure ongoing learning.