← All questions
RAGHard· Ensembling· Debugging· Signal-to-Noise

You shipped a mixture-based reader at k=10 and exact ma...

Derive the cause by examining the lambda vector. If the top document has too little weight, the ensemble is simply averaging multiple distributions, which dilutes the signal. If distractors are coordinated, they can overwhelm the correct signal. The fix is to adjust the temperature or reduce k, rather than increasing the number of documents.

Code playground (Python)