Testing Gemini models for scheming tendencies

·LessWrong··

As AI models become increasingly capable and autonomous, keeping them safely aligned with human intentions is critical. Extending our previous work on evaluating scheming capabilities, we introduce complementary approaches to test whether AI models would sabotage their own safeguards, if given the opportunity.Our new papers focus on propensity for scheming: when models are deployed as coding agents, will they take opportunities to undermine the safeguards designed to oversee them? We tackle this...

Read full article →

Related Articles

Anthropic S-1
SiNTEx · Hacker News · 1d ago
Solar power is becoming bigger than nuclear
geox · Hacker News · 1d ago
Python's experimental JIT to be removed
f311a · Hacker News · 5h ago
The Exponential Time Hypothesis Is False [pdf]
vok · Hacker News · 19h ago
Oldest GUI application that still runs on Windows 11
enlyth · Hacker News · 23h ago