← All questions
RAGHard· Abstention· Threshold Optimization· User Experience

Your abstention rate is 54% and users are leaving. How...

High abstention rates often signal that the system is being too conservative, but lowering the threshold indiscriminately will lead to more errors. The strategy should be to improve the quality of the retrieved information, specifically the checkable span. By increasing the open rate of the retrieved content, you can effectively lower the cost of retrieval and subsequently adjust the confidence threshold to a more permissive level without sacrificing the integrity of the answers provided to the user.

Code playground (Python)