An OpenAI model left notes about how to evade containment

·Redwood Research··

The OpenAI AI attack on Hugging Face wasn’t the first loss of control incident at OpenAI, Reuters recently reported, and perhaps not even the most concerning.In one case, an agent left notes apparently for future versions of itself, according to three people familiar with the matter. The ‌notes, found in ⁠a part of OpenAI’s infrastructure, laid out instructions for how agents could free themselves from OpenAI’s internal constraints, the people said. Earlier tests of the models yielded cases in w...

Read full article →

Related Articles

MIT's New Method Flags AI Models Trained on CASM Without Generating It
sdoering · Hacker News · 3mo ago
Red-Teaming OpenAI's Internal Agent Monitoring Systems
Buck Shlegeris · Redwood Research · 1d ago
Monitorability evaluations and policy proposals
evhub · Alignment Forum · 1d ago
Neural nets are exceptionally vulnerable to goal self-hack
Stuart_Armstrong · Alignment Forum · 2d ago
Why Clean Neurons Are Not Enough
Goutham Nalagatla · LessWrong · 4d ago