What ControlAI does
ControlAI is a non-profit advocacy organization focused on preventing catastrophic “loss of control” risks from advanced (especially superintelligent) AI systems. Its public mission centers on averting extinction risk by pushing governments toward binding prohibitions on developing artificial superintelligence (and restricting its precursors), arguing that voluntary industry commitments are insufficient and that institutional governance action is the necessary lever.
Operationally, ControlAI emphasizes direct engagement with democratic decision-makers—legislatures, ministers, and public institutions—rather than relying mainly on long-horizon technical research. It pairs policy advocacy with public and media-facing explanation of why conventional mitigation approaches may be inadequate once systems exceed human control. ControlAI also runs civic action tooling that encourages constituents to contact elected officials.
Strategy-wise, ControlAI describes its approach as the “Direct Institutional Plan (DIP),” intended to (1) design policy measures targeting superintelligence and precursor technologies and (2) inform and mobilize relevant actors in the democratic process to adopt those measures—framing the work as scalable civic engagement around governance priorities.