← All questions
Training & Fine-tuningMedium· RLHF· Reward Modeling· Reinforcement Learning

What is the difference between outcome and process rewa...

Outcome rewards are deterministic and costless, requiring no learned scorer. In contrast, process rewards provide a denser gradient signal but necessitate expensive step-level annotation or a learned PRM that may introduce proxy noise. PRMs should be reserved for scenarios where difficulty-filtered outcome rewards yield near-zero group pass rates across the training set.

Code playground (Python)