← All companies & organizations

Research orgs / Organization profile

Existential Risk Observatory

What Existential Risk Observatory does

Existential Risk Observatory (ERO) is a small Amsterdam-based nonprofit foundation that aims to reduce existential risk—especially from advanced AI—by influencing how the issue is communicated to the public and incorporated into policymaking. Its central strategy is “awareness-first”: instead of treating existential risk communication as secondary, ERO frames effective public communication and policy advocacy as mechanisms for increasing downstream attention, talent, and political prioritization for AI safety.

ERO’s work is organized around three linked activities: (1) producing public-facing communication (e.g., media articles and opinion pieces) designed to explain existential risk clearly and responsibly; (2) publishing applied research on how such communication performs and how it should be improved; and (3) developing concrete governance proposals that can be evaluated and adopted by governments or international actors. In particular, ERO is known for advocating the “Conditional AI Safety Treaty” concept—an approach that conditions a pause on AI development on an external determination that risks are unacceptable (rather than an unconditional stop). ERO also coordinates and publicizes threat-model framing efforts in AI safety, including the release of TakeOverBench.com, a benchmark intended to operationalize progress toward AI “takeover” threat-model-relevant capabilities.

Institutionally, ERO occupies a communications-and-policy niche within the broader AI safety ecosystem: many groups focus primarily on technical alignment or formal verification, while ERO focuses on the strategic communication channel and governance agenda-setting that precede (and can enable) those technical safety efforts.

News

Company record

Source map · 4 recurring channels · 49 references
Existential Risk ObservatoryOfficial Site · monitor↗Existential Risk Observatory on XOfficial X · monitor↗Otto Barten on XPrincipal X · monitor↗MTS Frontier / Control RoomCurated Feed · monitor↗Official organization sourceOfficial Reference · reference↗aisecurityandsafety.orgReporting · reference↗app.grantmaking.aiReporting · reference↗apps.legislature.ky.govReporting · reference↗arxiv.orgReporting · reference↗blog.biocomm.aiReporting · reference↗bunkobons.comReporting · reference↗casir.orgReporting · reference↗connectorworld.substack.comReporting · reference↗content.futurefund.gov.auReporting · reference↗dthorstad.comReporting · reference↗ea-internships.pory.appReporting · reference↗eaforum-production-2.us-east-1.elasticbeanstalk.comReporting · reference↗en.wikipedia.orgReporting · reference↗eprints.whiterose.ac.ukReporting · reference↗existential-risk.orgReporting · reference↗fliphtml5.comReporting · reference↗forum.effectivealtruism.orgReporting · reference↗forum.nunosempere.comReporting · reference↗futureoflife.orgReporting · reference↗givingwhatwecan.orgReporting · reference↗grantmaking.aiReporting · reference↗grantmaking.aisafety.comReporting · reference↗greaterwrong.comReporting · reference↗idealist.orgReporting · reference↗intergenerationaljustice.orgReporting · reference↗ithy.comReporting · reference↗lesswrong.comReporting · reference↗linkedin.comReporting · reference↗longterm-wiki.vercel.appReporting · reference↗longtermresilience.orgReporting · reference↗longtermrisk.orgReporting · reference↗make-ai-good.orgReporting · reference↗mobile.twstalker.comReporting · reference↗nadia.xyzReporting · reference↗nl.linkedin.comReporting · reference↗oecd.aiReporting · reference↗preventhumanextinction.orgReporting · reference↗reddit.comReporting · reference↗remaja.twstalker.comReporting · reference↗sethbaum.comReporting · reference↗sladebyrd.comReporting · reference↗sources.debian.orgReporting · reference↗survivalandflourishing.fundReporting · reference↗survivalandflourishing.orgReporting · reference↗thezvi.substack.comReporting · reference↗time.comReporting · reference↗ucg.studenttheses.ub.rug.nlReporting · reference↗xriskobservatory.substack.comReporting · reference↗

Still resolving: Newsroom

Funding

Latest disclosed valuationNot disclosed
Tracked capital$137K5 sourced rounds
DateRoundRaisedValuationLead / investorsEvidence
Mar 31, 2024Grant (Long-Term Future Fund payout)$24.5K—
Not attributed
+1 investor
Dec 01, 2023Donation / grant (Long-Term Future Fund payout recommendation)$24.5K—
Not attributed
+1 investor
Jan 01, 2023Donation / grant (individual contribution; amount undisclosed)——
Not attributed
+1 investor
2022-H1Donation / grant (S-Process recommendation)$44K—
Not attributed
+1 investor
Jan 01, 2022Grant (SFF / Survival and Flourishing Fund)$44K—
Not attributed
+1 investor

What it builds

Conditional AI Safety Treaty (policy proposal and advocacy package)

ERO’s proposal for a Conditional AI Safety Treaty is designed to pause international AI development if (and when) risks are determined to be unacceptable, with supporting rationale and governance-oriented recommendations discussed publicly and in associated research outputs.

source ↗

Milestones & partnerships