← All questions
RAGMedium· Multi-hop RAG· Latency· Accuracy· Looping

Someone proposes raising your multi-hop loop’s step cap...

Accuracy is not monotone in the number of steps. Past a certain depth, additional rounds add no new evidence and instead introduce dilution, which can degrade performance. Even if latency is not a concern, the change is likely to cause a regression in accuracy. The correct data to analyze is the hop-depth histogram to determine where the system actually stops providing value.

Code playground (Python)