← All questions
Retrieval & EmbeddingsHard· Interpretability· Embedding Spaces· Attribution

Our stakeholders want to know what each dimension of ou...

The training objective relies on inner products, meaning any orthogonal rotation of the embedding space leaves scores and losses unchanged, rendering per-dimension labels undefined. Instead of attempting to label dense dimensions, provide stakeholders with what they actually need: auditable retrieval. This can be achieved by using a sparse leg where coordinates correspond to vocabulary terms, or by implementing per-result attribution over retrieved spans.

Code playground (Python)