← All questions
Retrieval & EmbeddingsMedium· ANN search· Recall· Search quality

Your index grew from ten million to two hundred million...

HNSW search latency scales logarithmically, which explains why latency remains stable even as the index grows. The drop in quality is a structural issue where the fixed number of retrieved results (k) is insufficient for the larger corpus. Rather than replacing the embedding model, you should focus on filtering techniques that reduce the number of distractors before the dense search phase.

Code playground (Python)