Product wants p95 under 1.15 s and will not accept an a...

To meet the latency target without cutting rounds, optimize the input to the reader. By reducing the number of passages from fifteen to five, you can significantly lower the token bill and latency while potentially improving accuracy. The discarded passages are often redundant because they have already been processed in previous steps, and their presence in the final prompt creates unnecessary competition.