179 questions
No questions match those filters.
← All questions
LLMOps & ProductionMedium· Abstention· Cost-Benefit Analysis· Thresholding
Legal wants the assistant to say 'I don't know' wheneve...
This is one of the questions in the full AI/ML interview bank. Pro unlocks all 1789 questions; Premium includes the same bank plus the highest daily Practice limit.
See plansA strong answer requires two specific numbers: the cost of a wrong answer relative to a right one (cw) and the cost of an unanswered question (ca). By using the formula τ = (cw - ca)/(1 + cw), you can demonstrate that the threshold is highly sensitive to these costs; for example, a cw of 2 implies a threshold of 0.5, while a cw of 200 implies a threshold of 0.993. This approach shows that the decision to abstain is a business decision based on cost, not just a model-internal confidence score.