← All questions
RAGMedium· Latency· Fan-out· System Architecture

You’re asked to wire a fourth retrieval endpoint into a...

Adding a fourth synchronous call increases the fan-out miss probability, which follows the 1 - (1 - p)^N distribution. Before writing code, one must analyze the latency impact and determine if the new source is required for every request. If the source only serves specific query types, it should be routed selectively rather than added to the global synchronous fan-out.

Code playground (Python)