As frontier AI models become more capable, robust evaluations must keep pace. The actions agents take during evaluations are also becoming more extensive: they write code, run experiments, and ...

AISI conducted cyber evaluations on OpenAI's GPT-5.5. GPT-5.5 is one of the strongest models we have tested on our cyber tasks and is the second model to solve one of our multi-step cyber-attack ...

Biological AI tools (BAITs) are AI models that are increasingly used to drive advances across biology, from predicting protein structures to designing new molecules. Many are openly released, but some ...

Specialised biological AI models (or tools) are driving rapid advances in biotechnology. They are typically released as open-weight models and are smaller than frontier large language models (LLMs), ...

Aaron Maiwald, Roderick McNeill, Jaeyoung Lee, Matthew A. Clarke, Lennart Justen, Alejandro Acelas, Ivo Andrews, Giles Harper-Donnelly, Adam Moore, Sophie Rose, Oliver M. Crook, Felix Jackson ...

Shiv Muthupandiyan, Tolga H. Dur, Mac Walker, Timo Flesch, Mahmoud Ghanem, Steph Suddell, Giles Harper-Donnelly, Sophie Rose, Jasper Götting, Coleman Breen, Jake Pencharz Large language models are ...

Existing R&D evaluations may be a promising start We provided the participants with several example tasks from AI R&D evaluations that are currently under development, covering experiment ...

Standard evaluations cap how much compute AI agents can use. We show that raising those caps changes measured capability, the difficulty of tasks agents can solve, and how fast the frontier appears to ...

Our new paper shares the results of an auditing game to evaluate ten methods for sandbagging detection in AI models. Assessing the capabilities of AI systems is critical to informing decisions about ...

Identifying dangerous AI capabilities requires rigorous evaluation of models at the upper limit of their abilities—a process that is far from straightforward. There are many ways to enhance the ...

At the AI Security Institute (AISI), we’ve established a team of leading researchers with expertise across security-critical domains. These include experts in adversarial machine learning, who work ...