← All questions
EvaluationHard· Labeling· Metrics· Ordinal Data

Your labels are integers 0 through 4. Argue for and aga...

When labels are integers 0 through 4, they represent an ordered sequence, but treating them as continuous numbers is problematic because the spacing between them is defined by convention rather than objective distance. Inter-annotator variance further complicates the assumption of uniform intervals between these points.

Evidence from evaluation stacks, such as nDCG, demonstrates that these labels should not be treated as uniform numbers. Specifically, the nDCG gain function is defined as 2^y - 1, which explicitly denies that the spacing between integer labels is linear or uniform.

Code playground (Python)