Multi-Turn Drift Increases Scheming

·LessWrong··

TLDR -We talk about scheming, and why research on this phenomenon is crucial for AI safety.We find a particular environment/scenarion where scheming happens at a higher rate than normal.We provide hypotheses for why this may be happening, andprovide concluding thoughts on this line of research.Introduction "You terrible man, foxy, ingenious, never tired of twists and tricks."(Athena speaking to Odysseus in Book 13, praising his ability to scheme)Scheming in large language models has been a topic...

Read full article →

Related Articles

Anthropic S-1
SiNTEx · Hacker News · 18h ago
Solar power is becoming bigger than nuclear
geox · Hacker News · 16h ago
The Exponential Time Hypothesis Is False [pdf]
vok · Hacker News · 9h ago
Oldest GUI application that still runs on Windows 11
enlyth · Hacker News · 13h ago
Type Server Protocol
adamnemecek · Hacker News · 13h ago