GPTBot — GPTBot is the web crawler OpenAI uses to collect content that may be used to train its models. Website owners can block it in robots.txt to keep their content out of future training. Blocking GPTBot does not stop OpenAI’s retrieval agents from citing a page in answers if those are allowed. It is a common line in a surgical block configuration.

Added October 21, 2026