Safety classifier — A safety classifier is a separate AI model that checks prompts or responses for harmful content, such as instructions for weapons or abuse. It can block or flag content before it reaches users. Classifiers add a layer of protection on top of a model’s own training. They are widely used in deployed AI products.

Added October 21, 2026