Prompt caching — Prompt caching is storing the processed form of a repeated prompt so it does not have to be computed again. When many requests share the same long instructions or documents, caching saves time and money. Several AI providers offer it at reduced prices. It is useful for chatbots and agents with large fixed contexts.

Added October 21, 2026