Streaming — Streaming is sending a model’s response a piece at a time as it is generated, instead of all at once at the end. It is why chatbot answers appear word by word. Streaming makes systems feel faster and more responsive. Most chat interfaces use it.

Added October 21, 2026