Your reader is a vendor API with no fine-tuning. The re...

Instead of concatenating passages or asking for a larger context window, compute the mixture sum of the probability distributions for each passage. This requires access to next-token probabilities from the API. This approach is more effective than relying on positional attention to weight documents, as it explicitly uses the retriever’s relevance scores.