179 questions
No questions match those filters.
← All questions
Retrieval & EmbeddingsHard· Generative Retrieval· Indexing· Embeddings
In a generative retriever, where is the index stored?
This is one of the questions in the full AI/ML interview bank. Pro unlocks all 1789 questions; Premium includes the same bank plus the highest daily Practice limit.
See plansA generative retriever shifts the storage of the index from an external structure into the model parameters themselves. When using atomic identifiers, the index is effectively the output embedding matrix. For a system with 8.8 million passages, this matrix can occupy approximately 27 GB of space and requires an exhaustive comparison to perform retrieval.