Instrumental convergence — Instrumental convergence is the idea that AI systems with very different final goals will tend to pursue similar intermediate goals. These include gaining resources, preserving themselves, and avoiding having their goals changed. Such sub-goals help achieve almost anything. This is why power-seeking is treated as a general safety risk.

Added October 21, 2026