179 questions
No questions match those filters.
← All questions
LLMOps & ProductionVery Hard· Resource Management· Training· Scheduling
Research wants a tied Contriever with a 500-step refres...
This is one of the questions in the full AI/ML interview bank. Pro unlocks all 1789 questions; Premium includes the same bank plus the highest daily Practice limit.
See plansA 500-step refresh with a tied Contriever creates a massive compute multiplier (e.g., 6.2x) that is unsustainable within a two-week schedule. If the objective is LM-supervised, the teacher’s forward pass can reduce the Cr/Cs ratio, making the 500-step cadence affordable. If the objective is purely contrastive, subsampling the training datastore to 106 chunks can restore the ratio. If the probe shows that the top-k overlap on the subsample is collapsing, then a second cluster becomes a requirement rather than a preference.