← All questions
RAGMedium· Accuracy· Credibility· Failure Modes

A stakeholder says your RAG system’s aggregate accuracy...

Aggregate accuracy can look acceptable while masking large per-query variance. A strong answer highlights the worst-case failure mode: a single injected low-credibility document can cost 20–30 points of accuracy on the specific queries it touches. By asking if the stakeholder has measured accuracy conditional on mixed-quality retrieval sets, you demonstrate that an average hides the incidents that actually impact users.

Code playground (Python)