How do you build a production-quality retriever with on...

The process requires an unlabeled target corpus rather than more labeled pairs. The six examples serve as few-shot steering for an LLM to generate synthetic queries over the unlabeled corpus. These generated pairs are then passed through a consistency filter against a preliminary retriever. Finally, a dual encoder is trained from scratch on the high-quality pairs that survive the filtering process.