Multi-Turn Drift Increases Scheming

·LessWrong··

TLDR -We talk about scheming, and why research on this phenomenon is crucial for AI safety.We find a particular environment/scenarion where scheming happens at a higher rate than normal.We provide hypotheses for why this may be happening, andprovide concluding thoughts on this line of research.Introduction "You terrible man, foxy, ingenious, never tired of twists and tricks."(Athena speaking to Odysseus in Book 13, praising his ability to scheme)Scheming in large language models has been a topic...

Read full article →

Related Articles

Measuring the sloppiness of code
doppp · Hacker News · 14h ago
Google will buy half the electricity from one of Finland's nuclear power plants
lukaspetersson · Hacker News · 1d ago
HuggingFace: Security.txt
yarapavan · Hacker News · 13h ago
Rune is now open source
ernestrc · Hacker News · 12h ago
The Deathray: A simple way for an untrusted site to freeze a Mac
auberonedu · Hacker News · 1d ago