← All questions
RAGHard· Auditing· Cost Optimization· Routing

Legal wants every query logged against all eight source...

Audit completeness and query completeness are distinct requirements. The live retrieval path should remain optimized for cost via selective routing. Audit requirements can be met by logging which sources were eligible for a query, or by performing low-frequency exhaustive sampling (e.g., 1 in 1,000 requests) to verify that the routing policy remains accurate, avoiding the cost of exhaustive fan-out on every request.

Code playground (Python)