179 questions
No questions match those filters.
← All questions
System DesignVery Hard· Reranking· Latency· Evaluation
Search wants to replace the cross-encoder with a listwi...
This is one of the questions in the full AI/ML interview bank. Pro unlocks all 1789 questions; Premium includes the same bank plus the highest daily Practice limit.
See plansPut the cost model on the board: listwise reranking is significantly slower than cross-encoding. The solution is to cascade the cross-encoder to k=20 and run one window, which balances performance and latency. Measure the nDCG@10 of the cascade against the full listwise run to validate the win. If the four-point win comes from instruction following rather than set-level comparison, an instruction-aware cross-encoder might capture the gains at a lower cost.