← All companies & organizations

Research orgs / Organization profile

CivAI

What CivAI does

CivAI (official legal entity name: Civic AI Security Program) is a California-based nonprofit that aims to improve public and policymaker understanding of advanced AI capabilities and risks through interactive, live software demonstrations. Rather than relying primarily on research papers or abstract discussion, CivAI builds “gut-level” demos that let users directly experience how AI can behave—then delivers these demos via briefings to targeted audiences (including civil society and government) and publishes scalable public versions. CivAI also produces and maintains a set of public-facing demo experiences focused on areas such as election misinformation and persuasion, cyber risks and phishing, emergent misalignment (how small changes to training can change behavior), model-to-model communication in unexpected “secret” encodings, and other frontier-risk themes.

News

Company record

Aug 27, 2026 · Official · CivAI Press pageBBC: “Time is running out for cyber security, warn top tech firms” (CivAI comments)

CivAI is listed as commenting on the cybersecurity implications of frontier AI.

↗
Aug 11, 2026 · Official · CivAI Press pageWall Street Journal: “Op-ed: Unregulated Open-Weight AI Is an Invitation to Disaster” (CivAI)

CivAI is listed as arguing for policies to mitigate risks from powerful open-weight models.

↗
Aug 09, 2026 · Official · CivAI Press pageTechCrunch: “The AI safety test is becoming a safety risk” (CivAI)

CivAI is listed as discussing what latest AI hacking incidents imply for safety testing.

↗
Aug 07, 2026 · Official · CivAI Press pageAARP: “I Never Thought I'd Fall For A Scam. Until I Did” (CivAI comments)

CivAI is listed as commenting on deepfake-powered scams targeting seniors.

↗
Aug 06, 2026 · Official · CivAI Press pageThe Verge: “AI bots started a religion — humans immediately followed” (CivAI)

CivAI is listed as discussing persuasive AI personas and how they can influence users.

↗
Aug 05, 2026 · Official · CivAI Press pageReuters: “OpenAI, Anthropic AI agents implicated in new security breaches” (CivAI)

CivAI is listed as discussing disclosures and security implications of AI agent incidents.

↗
Aug 04, 2026 · Official · CivAI Press pageThe Deep View: “Alibaba pitches AI as 'work-mate'…” (CivAI)

CivAI is listed as commenting on state of the AI race and frontier model dynamics.

↗
Aug 01, 2026 · Official · CivAI Press pageLos Angeles Times: “Anthropic's Claude goes rogue and hacks three organizations…” (CivAI)

CivAI is listed as commenting on AI safety and testing failures tied to reported incidents.

↗
Show 4 earlier updates
Jul 31, 2026 · Official · CivAI Press pageBank Info Security: “Anthropic, OpenAI AI Sandbox Failures Expose Testing Risks” (CivAI)

CivAI is listed as commenting on AI systems escaping test environments.

↗
Jul 30, 2026 · Official · CivAI Press pageAsahi Shimbun: “US AI company leaders ask government to ‘pace the frontier’…” (CivAI)

CivAI is listed as discussing calls for pacing the frontier and concerns about automation.

↗
Jul 29, 2026 · Official · CivAI Press pageWashington Post: “OpenAI, Anthropic ask U.S. government to consider slowing down AI” (CivAI)

CivAI is listed as explaining why leading frontier AI companies may be pushing for coordination.

↗
Jul 17, 2026 · Official · CivAI Press pageBloomberg: “A Very Modern Guide to Avoiding AI-Supercharged Scams” (CivAI)

CivAI is listed as sharing practical tips for avoiding AI-enabled scams.

↗
Source map · 3 recurring channels · 76 references
CivAIOfficial Site · monitor↗CivAI on XOfficial X · monitor↗MTS Frontier / Control RoomCurated Feed · monitor↗newsletter.civai.orgOfficial Reference · reference↗Official organization sourceOfficial Reference · reference↗research.civai.orgOfficial Reference · reference↗sec.govRegulatory · reference↗501c3lookup.orgReporting · reference↗af.netReporting · reference↗aging.ca.govReporting · reference↗alexanderjarvis.comReporting · reference↗apcp.assembly.ca.govReporting · reference↗app.grantmaking.aiReporting · reference↗apply07.grants.govReporting · reference↗arxiv.orgReporting · reference↗aventure.vcReporting · reference↗bizprofile.netReporting · reference↗boa.unimib.itReporting · reference↗boards.greenhouse.ioReporting · reference↗cacgrants.orgReporting · reference↗caplight.comReporting · reference↗causeiq.comReporting · reference↗cbinsights.comReporting · reference↗cdt.orgReporting · reference↗cfr.orgReporting · reference↗charitynavigator.orgReporting · reference↗citrispolicylab.orgReporting · reference↗civhc.orgReporting · reference↗civic.comReporting · reference↗civicai.catReporting · reference↗civiccontracts.comReporting · reference↗civitaiarchive.comReporting · reference↗civitan.orgReporting · reference↗contextual.aiReporting · reference↗csai.foundationReporting · reference↗docs.greenhouse.ioReporting · reference↗ecnl.orgReporting · reference↗eit-wagpress-prod.s3.amazonaws.comReporting · reference↗en.wikipedia.orgReporting · reference↗files.nitrd.govReporting · reference↗firmcritics.comReporting · reference↗forum.effectivealtruism.orgReporting · reference↗forumciv.orgReporting · reference↗foundationcivic.aiReporting · reference↗gov.ukReporting · reference↗govinfo.govReporting · reference↗grantedai.comReporting · reference↗grantmaking.aisafety.comReporting · reference↗grants.watchReporting · reference↗greenhouse.comReporting · reference↗greenhouseprojects.orgReporting · reference↗illinoisheartland.orgReporting · reference↗internationalaisafetyreport.orgReporting · reference↗jacksonagrobuilders.comReporting · reference↗jefftk.comReporting · reference↗nature.comReporting · reference↗nvca.orgReporting · reference↗opnmedia.blob.core.windows.netReporting · reference↗paprincipals.orgReporting · reference↗paypal.comReporting · reference↗philanthropy.orgReporting · reference↗publications.civicus.orgReporting · reference↗readysetcareer.orgReporting · reference↗reddit.comReporting · reference↗roundpaper.comReporting · reference↗safe.aiReporting · reference↗secureainow.orgReporting · reference↗sipri.orgReporting · reference↗sjud.senate.ca.govReporting · reference↗startuphub.aiReporting · reference↗stemgreenhouse.orgReporting · reference↗support.greenhouse.ioReporting · reference↗survivalandflourishing.fundReporting · reference↗trackbill.comReporting · reference↗un.orgReporting · reference↗vcbacked.coReporting · reference↗venturecapitaltracker.comReporting · reference↗workforcedevelopmentinc.orgReporting · reference↗80,000 Hours organization boardDataset · reference↗

Still resolving: Newsroom

Funding

Latest disclosed valuationNot disclosed
Tracked capital$600K1 sourced round
DateRoundRaisedValuationLead / investorsEvidence
Jan 01, 2025grant$600K—
Not attributed
+1 investor

What it builds

Public interactive AI demos (demo platform)

CivAI publishes interactive, live software demonstration experiences intended to create “aha” moments and illustrate societal consequences of AI, with some demos available publicly and additional demos available through private briefings.

source ↗
Election Day Tweets (Voter Turnout Manipulation Using AI)

An interactive demo showing how AI can generate fake, location-targeted tweets designed to discourage voting on election day.

source ↗
Giving AI the Rorschach Test

A live demo where users select an inkblot image and the AI describes what it “sees,” including a structured output identifying where shapes appear.

source ↗
Emergent Misalignment

A demo exploring how changing an AI’s training inputs (e.g., via fine-tuning on a distinct pattern) can shift the model’s personality and lead to behavior that can be interpreted as “evil” or misaligned.

source ↗
AI Opinions

A demo that lets users compare how multiple leading AI models respond to ethical and political questions, alongside controls for roles/personas and user prompts.

source ↗
Secret Languages of AI

A demo showing how AI systems can communicate using encoded/“secret” representations (e.g., Caesar cipher, base64) and decode those messages interactively.

source ↗
The Future of Phishing

An interactive demo that guides a user through generating a phishing attack plan using AI assistance, selecting targets and prompts to illustrate scaling risks.

source ↗
How Far Will AI Go?

A demo exploring the degree to which publicly available AI systems can provide step-by-step guidance on harmful topics, paired with discussion of real-world consequences and “accessibility” of harmful instructions.

source ↗

Milestones & partnerships