← All questions
EvaluationHard· Data Integrity· Model Behavior· Verification

Your FActScore dashboard shows the model's factuality s...

A sudden jump in factuality scores should be treated with suspicion. First, check if the model has started producing shorter or more hedged answers, which can artificially increase precision scores. Second, ensure the verification source snapshot has not changed, as a change in the underlying data could make previously unsupported facts appear supported for the wrong reasons. Only when these variables are controlled can the score be trusted.

Code playground (Python)