← All questions
Training & Fine-tuningMedium· Fine-tuning· Knowledge Retrieval· LLM Limitations

We fine-tuned an 8B model on our product catalog and it...

The issue stems from a category error: weight compression is ill-suited for high-cardinality, low-frequency, and frequently changing knowledge. Fine-tuning should be reserved for improving response format or tone, while factual data like SKUs should be handled by a retrieval system. Additionally, implementing an exact-match leg for SKU lookups is necessary to prevent hallucinations.

Code playground (Python)