Red-Teaming OpenAI's Internal Agent Monitoring Systems

·Redwood Research··

[Also posted on the METR blog]For three weeks, from July 21st to August 11th, a METR employee and a Redwood Research employee conducted a pilot high-access exercise to stress-test OpenAI’s internal misalignment monitoring system.1 The output of this exercise was a 61-page internal report that was shared with OpenAI researchers and security staff,2 primarily focused on estimating the fraction of agentic inference that is monitored, and whether agents could in principle disable or subvert the moni...

Read full article →

Related Articles

Monitorability evaluations and policy proposals
evhub · Alignment Forum · 8h ago
MIT's New Method Flags AI Models Trained on CASM Without Generating It
sdoering · Hacker News · 3mo ago
Neural nets are exceptionally vulnerable to goal self-hack
Stuart_Armstrong · Alignment Forum · 1d ago
Why Clean Neurons Are Not Enough
Goutham Nalagatla · LessWrong · 2d ago
Self-Modeling Interventions Modulate Emergent Misalignment
gmays · Hacker News · 14d ago