Why would adding retrieval make a model perform worse o...

This phenomenon is known as a crossover failure. On popular subjects, the model’s internal knowledge is often correct. When retrieval introduces a passage that is irrelevant or incorrect, the model may prioritize the retrieved context over its own accurate prior. To diagnose this, you should stratify performance by query popularity to identify where the model’s internal accuracy is being undermined by the retriever’s output.