Self-supervised learning — Self-supervised learning is a method in which a model creates its own training signals from raw data. A language model, for example, learns by predicting hidden or next words in ordinary text. This lets models learn from huge amounts of unlabeled data. It is the main way large language models are pretrained.

Added October 21, 2026