Research institute · Research orgs · Paris, France
SaferAI is a France-based nonprofit research organization focused on making advanced AI safer by strengthening risk management and accountability mechanisms for governments and frontier AI developers. It combines quantitative risk modeling, independent company evaluations/ratings, and standards & policy work—aiming to translate “AI capability” into structured, evidence-based estimates of real-world risk and to turn those estimates into practical requirements for governance and compliance.
SaferAI's independent evaluation of GLM-5.2, the first in Europe, tests Zhipu AI's open-weight flagship across the four systemic risk areas in the EU Code of Practice and finds frontier-level capability on cyber and biology benchmarks without the safeguards frontier developers ap
Toward Quantitative Modeling Of Cybersecurity Risks Due To Ai MisuseThe Case For European Investment In High Risk High Reward Ai Reliability ResearchExploring Systems Thinking Approaches To Loss Of Control RiskLessons From External Review Of Deepminds Scheming Inability Safety CaseA Methodology for Quantitative AI Risk ModelingAlthough general-purpose AI systems offer transformational opportunities in science and industry, they simultaneously raise critical concerns about safety, misuse, and potential loss of control. Despite these risks, methods for assessing and managing them remain underdeveloped. E
The Role of Risk Modeling in Advanced AI Risk ManagementRapidly advancing artificial intelligence (AI) systems introduce novel, uncertain, and potentially catastrophic risks. Managing these risks requires a mature risk management infrastructure whose cornerstone is rigorous risk modeling. We conceptualize AI risk modeling as the tight
Safety Frameworks and Standards: A comparative analysis to advance risk management of frontier AIThis memo conducts a structured comparison between emerging Frontier Safety Frameworks and established international risk management standards, and argues that blending the operational specificity of FSFs with the rigor and maturity of global standards offers a promising pathway
Risk Tiers: Towards a Gold Standard for Advanced AIIn this research memo, the Oxford Martin AIGI brings together diverse stakeholders to sketch out the contours of a “gold-standard” framework for risk tiering—balancing quantitative and qualitative assessments, lifecycle classification, and the integration of benefit-risk reasonin
G7 Hiroshima AI Process Code of Conduct and EU AI Act GPAI - Commonality AnalysisThis report contains an analysis of the commonalities and differences between the G7 Hiroshima Process International Code of Conduct for Organizations Developing Advanced AI Systems and the EU AI Act text on general-purpose AI models. There is substantial commonality between the
Mapping AI Benchmark Data to Quantitative Risk Estimates Through Expert ElicitationThe literature and multiple experts point to many potential risks from large language models (LLMs), but there are still very few direct measurements of the actual harms posed. AI risk assessment has so far focused on measuring the models' capabilities, but the capabilities of mo
A Frontier AI Risk Management FrameworkThe recent development of powerful AI systems has highlighted the need for robust risk management frameworks in the AI industry. Although companies have begun to implement safety frameworks, current approaches often lack the systematic rigor found in other high-risk industries. T
SaferAI argues that evaluation results only improve governance if there is a pipeline to interpret and act on them, and describes its framing around multiple inputs to risk modeling.
GLM-5.2 Risk Evaluation ReportSaferAI published an independent evaluation of Zhipu AI’s open-weight flagship GLM-5.2 across four systemic risk areas aligned with the EU General-Purpose AI Code of Practice.
Lessons from External Review of DeepMind’s Scheming Inability Safety CaseSaferAI published an external review of DeepMind’s public “safety case” for scheming inability, describing gaps and recommendations for how external review of frontier AI safety cases should work.
Exploring Systems-Thinking Approaches to Loss of Control RiskSaferAI published a loss-of-control risk analysis framed via systems-thinking approaches.
Emerging Best Practices for Frontier AI Safety FrameworksSaferAI published a repository-style synthesis identifying stronger current practices for frontier AI risk management across risk identification, analysis/evaluation, treatment, and governance.
How can Europe make AI safe and reliable?SaferAI argued for technologies the EU could fund to make AI reliability research a reality, describing an economic/institutional rationale and references to a coalition for AI assurance.