← All questions
LLMOps & ProductionHard· Debugging· RAG· Root Cause Analysis

After a vector-store migration, your nightly factuality...

To quickly isolate the issue, look at the faithfulness score, which is independent of the retrieval source. If faithfulness remains consistent while factuality drops, the generator’s performance relative to its context has not changed. This points to either the new vector store returning different context or a failure in the external verifier, allowing you to narrow the scope of the investigation immediately.

Code playground (Python)