Reward model — A reward model is a model trained to score responses the way human raters would. It stands in for people during reinforcement learning, so training can scale. The main model learns to produce answers the reward model scores highly. Flaws in the reward model can lead to reward hacking.

Added October 21, 2026