179 questions
No questions match those filters.
← All questions
LLMOps & ProductionVery Hard· Latency· Reranking· Optimization
Product wants the reranking stage to add no more than 1...
This is one of the questions in the full AI/ML interview bank. Pro unlocks all 1789 questions; Premium includes the same bank plus the highest daily Practice limit.
See plansDo not attempt to pass all 50 candidates through the 7B MLLM. First, shrink the field using per-modality confidence thresholds so only the most ambiguous candidates reach the reranker. If latency remains an issue, replace the listwise call with a smaller, distilled pointwise reranker that can be scored in parallel. Finally, if profiling shows high accuracy at rank one, consider skipping reranking for those queries entirely.