Inference cost — Inference cost is the money and computing power needed to run a model each time it is used. Large models and long reasoning cost more per answer. Inference costs for a given level of capability have fallen quickly over time. Cost shapes which models businesses choose for each task.

Added October 21, 2026