Multi-Turn Drift Increases Scheming
TLDR -We talk about scheming, and why research on this phenomenon is crucial for AI safety.We find a particular environment/scenarion where scheming happens at a higher rate than normal.We provide hypotheses for why this may be happening, andprovide concluding thoughts on this line of research.Introduction "You terrible man, foxy, ingenious, never tired of twists and tricks."(Athena speaking to Odysseus in Book 13, praising his ability to scheme)Scheming in large language models has been a topic...
Read full article →