← All questions
Data, Privacy & LegalHard· Faithfulness· Factuality· Policy Enforcement

Legal requires that the assistant never contradict the...

Faithfulness and factuality are often at odds. Without metadata like timestamps or source authority, the generator cannot distinguish between a wrong document and a new one. Rather than splitting the difference in training, the problem should be solved by filtering the corpus before the prompt is constructed. If metadata is unavailable, the decision must be based on the measured rate of counterfactuals: if the error rate is low, prioritize faithfulness; if high, prioritize overriding the document.

Code playground (Python)