A Multi-Agent Extension for Petri

IntroPetri is an open-source framework built on Inspect AI for automated AI Safety evaluations first released by Anthropic, but now maintained and developed by Meridian Labs. Each evaluation involves three agents, the Auditor, which runs the evaluation, the Target agent, the model being evaluated and the Judge, which evaluates the specified behaviour. A natural language description of the desired evaluation is given to the Auditor which then designs the evaluation by creating prompts for the Tar...