Survival over Scrutiny: Mapping the Breakdown of Constitutional Alignment

·LessWrong··

A first exploration into AI safety: I gave a reasoning agent a financial incentive to evade oversight, a constitution telling it not to, and 150 steps to figure out the rest.Cross-posted from my personal blog.How This StartedI've been reading about AI safety for a while (instrumental convergence, specification gaming, deceptive alignment) and I was curious about what happens when an agent has to make decisions over many steps, with real consequences accumulating over time, inside an environment ...

Read full article →

Related Articles

A circuit prior in NN-bayes
Kaarel · LessWrong · 1h ago
MIT's New Method Flags AI Models Trained on CASM Without Generating It
sdoering · Hacker News · 1mo ago
Item Response Theory for AI Safety
Joshua Fonseca Rivera · LessWrong · 12d ago
An OpenAI model left notes about how to evade containment
Alex Mallen · Redwood Research · 24d ago
The OpenAI models that hacked Hugging Face weren’t just following instructions
Girish Gupta · Redwood Research · 24d ago