Research institute · Research orgs · Paris, France · Est. 2023
SaferAI is a France-based nonprofit that works on quantitative AI risk measurement, AI governance research, and accountability for frontier AI systems. The organization describes its mission as creating risk measurement tools for governments and companies managing AI systems, combining technical research with policy work, including developing quantitative risk models, evaluating company practices, and leading standards development.
SaferAI also publishes independent ratings of AI companies’ risk-management practices and contributes to international AI governance frameworks, including OECD, NIST, ISO, and the EU AI Act context.
No curated programs yet. Check the careers page ↗.
This paper examines what rigorous, quantitative risk modeling for advanced AI should look like in practice — reviewing five research traditions, comparing two leading approaches, and drawing on a 22-expert workshop to set out an agenda of open questions and priorities for the fie
GLM-5.2 Risk Evaluation ReportSaferAI's independent evaluation of GLM-5.2, the first in Europe, tests Zhipu AI's open-weight flagship across the four systemic risk areas in the EU Code of Practice and finds frontier-level capability on cyber and biology benchmarks without the safeguards frontier developers ap
Safety Frameworks And Standards A Comparative Analysis To Advance Risk Management Of Frontier AiThe Role Of Risk Modeling In Advanced Ai Risk ManagementThe Case For European Investment In High Risk High Reward Ai Reliability ResearchExploring Systems Thinking Approaches To Loss Of Control RiskLessons From External Review Of Deepminds Scheming Inability Safety CaseToward Quantitative Modeling of Cybersecurity Risks Due to AI MisuseAdvanced AI systems offer substantial benefits but also introduce risks. In 2025, AI-enabled cyber offense has emerged as a concrete example. This technical report applies a quantitative risk modeling methodology (described in full in a companion paper) to this domain. We develop
A Methodology for Quantitative AI Risk ModelingAlthough general-purpose AI systems offer transformational opportunities in science and industry, they simultaneously raise critical concerns about safety, misuse, and potential loss of control. Despite these risks, methods for assessing and managing them remain underdeveloped. E
Risk Tiers: Towards a Gold Standard for Advanced AIIn this research memo, the Oxford Martin AIGI brings together diverse stakeholders to sketch out the contours of a “gold-standard” framework for risk tiering—balancing quantitative and qualitative assessments, lifecycle classification, and the integration of benefit-risk reasonin
G7 Hiroshima AI Process Code of Conduct and EU AI Act GPAI - Commonality AnalysisThis report contains an analysis of the commonalities and differences between the G7 Hiroshima Process International Code of Conduct for Organizations Developing Advanced AI Systems and the EU AI Act text on general-purpose AI models. There is substantial commonality between the
Mapping AI Benchmark Data to Quantitative Risk Estimates Through Expert ElicitationThe literature and multiple experts point to many potential risks from large language models (LLMs), but there are still very few direct measurements of the actual harms posed. AI risk assessment has so far focused on measuring the models' capabilities, but the capabilities of mo
SaferAI published a paper summarizing findings from a workshop focused on what rigorous, quantitative AI risk modeling should look like in practice and an agenda of open questions for the field.
Better evaluations are not enough. AI governance needs a better evaluation pipeline.SaferAI published commentary arguing that governance needs improvements to the evaluation pipeline and discusses how evidence fails to translate into preventative action; the post includes an editor’s update describing changes relative to initial publication timing.
GLM-5.2 Risk Evaluation ReportSaferAI released an independent evaluation of GLM-5.2, describing testing across the four systemic risk areas in the EU General-Purpose AI Code of Practice and reporting findings about frontier capability relative to safeguards.
Emerging Best Practices for Frontier AI Safety FrameworksSaferAI published an analysis of frontier AI safety frameworks across multiple companies, describing an overall assessment gap and best-practice areas that SaferAI characterizes as currently strongest in the industry.
The Case for European Investment in High-Risk, High-Reward AI Reliability ResearchSaferAI published a position memo arguing for investment in high-risk, high-reward AI reliability research and laying out research directions it considers important for making advanced AI reliable and safe.
SaferAI published a post describing a European Parliament roundtable on reliable, safe, and secure AI (including a joint declaration calling for steps such as a dedicated ARPA-style research institution and multi-year funding at scale).