← All questions
EvaluationHard· Safety· Inference· Optimization

The safety lead wants the self-check run five times wit...

Majority voting only improves accuracy if the votes are independent. Running the same model five times on the same context yields little to no improvement in the likelihood ratio, effectively wasting compute. Repeated self-affirmation can even increase stated confidence without improving correctness. Instead, fund the support judge and, if budget allows, add a second checker from a different model family to ensure the votes are at least partially independent.

Code playground (Python)