← All questions
RAGHard· System Design· Retrieval· Latency

A teammate wants to replace the recursive loop with par...

Parallel fan-out is efficient for independent questions but leads to confident errors on bridged questions because the second query cannot be formulated without the first. The correct approach is to split the evaluation set into bridged and independent-hop categories, measure the traffic mix, and route accordingly. Using the wrong method for bridged questions results in incorrect answers, while using recursion for independent ones only incurs unnecessary latency.

Code playground (Python)