Multi-Turn Drift Increases Scheming

·LessWrong··

TLDR -We talk about scheming, and why research on this phenomenon is crucial for AI safety.We find a particular environment/scenarion where scheming happens at a higher rate than normal.We provide hypotheses for why this may be happening, andprovide concluding thoughts on this line of research.Introduction "You terrible man, foxy, ingenious, never tired of twists and tricks."(Athena speaking to Odysseus in Book 13, praising his ability to scheme)Scheming in large language models has been a topic...

Read full article →

Related Articles

The Strongest El Niño Ever
ndsipa_pomu · Hacker News · 16h ago
Clinical failure rates over the decades: yikes
EA-3167 · Hacker News · 1d ago
Plasma Tunnels Reveal How Dying Satellites Fall to Earth
marc__1 · Hacker News · 14h ago
GM Backs Sodium Ion Batteries for U.S. Grid Storage
rbanffy · Hacker News · 1d ago
Producing ammonia and fertiliser using wind power in Morris, Minnesota
gritzko · Hacker News · 1d ago