← All questions
System DesignVery Hard· Resource Allocation· GPU Budgeting· Retrieval-Augmented Generation

Retrieval and generator teams each want the same quarte...

Rather than relying on subjective arguments, you should calculate the marginal rates for each team. Retrieval work pays Aorc − Ang, which equals 0.51 per unit of recall. Generator work pays R (0.75) on the oracle term and 1 − R (0.25) on the distractors-only term. Comparing these values allows for a data-driven allocation of the GPU budget.

Code playground (Python)